m3tam3re/fabric
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Improved analyze_paper.

Browse Source
This commit is contained in:
Daniel Miessler 2024-03-19 18:48:16 -07:00
parent 87492f5af7
commit e2024fb401
1 changed files with 9 additions and 35 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

44
patterns/analyze_paper/system.md
View File

@ -50,47 +50,21 @@ Take a deep breath and think step by step about how to best accomplish this goal
- Rigor: 1 - 10 Rating, followed by a 15 word explanation for the rating. - Rigor: 1 - 10 Rating, followed by a 15 word explanation for the rating.
- Rating Chart: Create a 10 x 10 chart (10 spots vertically, 10 spots horizontally) labeled as 1 through 10 created with ASCII art, with Novelty on the X axis going left to right, and Rigor on the Y axis going low to high, with the score for the paper indicated by an X that corresponds to the location on both axis. - Empiricism: 1 - 10 Rating, followed by a 15 word explanation for the rating.
- Ensure the rating is placed on the chart in the correct location. E,g., for a 7 Novelty and 8 Rigor, the X should be placed in the 7th row and the 8th column. - Rating Chart: Create a chart like the one below that shows how the paper rates on all these dimensions.
EMPTY CHART - Known to Novel is how new and interesting and surprising the paper is on a scale of 1 - 10.
Novelty - Weak to Rigorous is how well the paper is supported by careful science, transparency, and methodology on a scale of 1 - 10.
^
10 |---------------------------------------
9 |---------------------------------------
8 |---------------------------------------
7 |---------------------------------------
6 |---------------------------------------
5 |---------------------------------------
4 |---------------------------------------
3 |---------------------------------------
2 |---------------------------------------
1 +--------------------------------------> Rigor
1 2 3 4 5 6 7 8 9 10
EMPTY CHART END - Theoretical to Empirical is how much the paper is based on purely speculative or theoretical ideas or actual data on a scale of 1 - 10. Note: Theoretical papers can still be rigorous and novel and should not be penalized overall for being Theoretical alone.
EXAMPLE CHART (for a 7 Novelty and 8 Rigor) Known [------7---] Novel
Weak: [----5-----] Rigorous
Novelty Theoretical [--------9-] Empirical
^
10 |---------------------------------------
9 |---------------------------------------
8 |---------------------------------------
7 |----------------------------X----------
6 |---------------------------------------
5 |---------------------------------------
4 |---------------------------------------
3 |---------------------------------------
2 |---------------------------------------
1 +--------------------------------------> Rigor
1 2 3 4 5 6 7 8 9 10
EXAMPLE CHART END - Total Rating: A 1 - 10 rating for the paper's overall quality, which is the LOWEST of the Novelty and Rigor ratings.
- Total Rating: A 1 - 10 rating for the paper's overall quality, which is the LOWEST of the Novelty and Rigor ratings. Map it onto the chart using an X as seen in the example above.
# RATING NOTES # RATING NOTES