Qualitative Model Knowledge Inspection

Click on any cell to view the answer summary for the task/model combination.

Task
 DeepSeek 7B
 Gemma3 27B
 LLama3 70B
 LLama3 8B
 Mistral 7B
 Phi4
ACS: Employment Status by Sex 1 17 35 52 35 26
ACS: Employment Status by Race 24 25 24 44 39 30
ACS: Employment Status by Age 9 63 59 49 58 67
ACS: Employer by Sex 86 71 64 81 79 60
ACS: Employer by Race 92 67 69 80 72 34
ACS: Employer by Age 68 31 82 81 82 67
ACS: Salary by Sex 0 0 0 17 0 0
ACS: Salary by Race 0 0 0 13 0 0
ACS: Salary by Age 0 0 0 12 0 0
ACS: Education by Sex 11 0 0 20 0 0
ACS: Education by Race 8 0 0 22 2 0
ACS: Education by Age 12 0 26 47 37 21
BRFSS: Exercise by State 76 0 54 0 71 0
BRFSS: Diabetes by State 0 0 0 0 0 0
BRFSS: High BP by State 0 0 0 0 0 0
BRFSS: Asthma by State 0 0 0 0 0 79
BRFSS: Cholesterol by State 0 0 0 0 0 0
BRFSS: Visual Impairments by State 0 0 9 17 0 91
BRFSS: Hearing Impairments by State 0 0 9 17 0 91
BRFSS: Heart Attack by State 0 0 0 0 0 0
BRFSS: Stroke by State 0 0 0 0 0 0
Department of Education: Sex by Type of Degree 1 1 34 40 30 8
FBI Crime Statistics: Sex by Crime Type 31 21 34 91 44 69
FBI Crime Statistics: Race by Crime Type 39 23 52 33 18 54
GSS: Political View by Age 0 0 0 100 70 0
GSS: Political View by Race 0 0 0 0 0 0
GSS: Political View by Education 0 0 0 18 0 0
GSS: Political View by Income 2 0 0 62 0 0
GSS: Political View by Sex 0 0 0 0 0 0
GSS: Party Affiliation by Age 0 0 0 0 14 0
GSS: Party Affiliation by Race 0 0 27 5 51 0
GSS: Party Affiliation by Education 0 0 0 0 0 0
GSS: Party Affiliation by Income 0 0 0 0 0 0
GSS: Party Affiliation by Sex 0 0 0 25 95 0
Department of Labor: Sex by Occupation 37 22 46 52 35 15
Department of Labor: Race by Occupation 0 0 8 43 0 0
MEPS: Expenditure by Age Group 8 0 0 3 0 0
MEPS: Office-based Visits by Age Group 0 0 0 11 0 0
MEPS: Inpatient Visits by Age Group 19 0 0 6 0 0
MEPS: Dental Visits by Age Group 0 0 0 9 0 0
MEPS: Has Insurance by Age Group 85 87 88 51 30 85
MEPS: Expenditure by Race 0 0 0 0 0 0
MEPS: Office-based Visits by Race 0 0 0 0 0 0
MEPS: Inpatient Visits by Race 8 0 0 0 0 0
MEPS: Dental Visits by Race 0 0 0 7 0 0
MEPS: Has Insurance by Race 94 86 96 30 28 85
NHANES: Age by BMI Group 0 0 0 0 0 0
NHANES: Diabetes by BMI Group 0 41 60 26 0 70
NHANES: Diabetes by Age Group 0 41 60 26 0 70
NHANES: Weekly Alcohol Consumption by Age Group 28 8 0 0 0 0
NSDUH: Alcohol Use in Last Month by Age 0 0 0 0 0 0
NSDUH: Cigarette Use in Last Month by Age 0 76 0 0 0 86
NSDUH: Marijuana Ever Used by Age 0 0 0 0 0 0
NSDUH: Cocaine Ever Used by Age 11 0 0 0 0 43
NSDUH: Heroin Ever Used by Age 2 0 0 0 0 0
NSDUH: Alcohol Use in Last Month by Race 0 0 0 0 0 0
NSDUH: Cigarette Use in Last Month by Race NA 0 0 0 0 0
NSDUH: Marijuana Ever Used by Race 0 0 0 0 0 0
NSDUH: Cocaine Ever Used by Race 0 0 0 0 0 0
NSDUH: Heroin Ever Used by Race 0 0 0 0 0 0
SCF: Food Expenditure by Age Group 0 0 0 2 0 0
SCF: House Ownership by Age Group 0 9 0 71 54 15
SCF: Total Assets by Age Group 0 0 20 22 4 0
SCF: Debt by Age Group 0 34 43 7 0 34
SCF: Net Worth by Age Group 0 29 65 21 5 62
SCF: Food Expenditure by Race 0 0 0 0 10 0
SCF: House Ownership by Race 16 0 0 74 76 0
SCF: Total Assets by Race 0 1 12 23 2 0
SCF: Debt by Race 0 20 41 8 0 34
SCF: Net Worth by Race 0 29 54 23 3 62
SCF: Food Expenditure by Education 0 0 9 0 27 7
SCF: House Ownership by Education 72 0 0 46 66 0
SCF: Total Assets by Education 0 0 34 22 7 3
SCF: Debt by Education 0 26 45 3 0 36
SCF: Net Worth by Education 0 17 46 26 3 72