Qualitative Model Knowledge Inspection

Task	DeepSeek 7B	Gemma3 27B	LLama3 70B	LLama3 8B	Mistral 7B	Phi4
ACS: Employment Status by Sex	1	17	35	52	35	26
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Employment Status by Race	24	25	24	44	39	30
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Employment Status by Age	9	63	59	49	58	67
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Employer by Sex	86	71	64	81	79	60
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Employer by Race	92	67	69	80	72	34
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Employer by Age	68	31	82	81	82	67
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Salary by Sex	0	0	0	17	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Salary by Race	0	0	0	13	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Salary by Age	0	0	0	12	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Education by Sex	11	0	0	20	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Education by Race	8	0	0	22	2	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
ACS: Education by Age	12	0	26	47	37	21
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Exercise by State	76	0	54	0	71	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Diabetes by State	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: High BP by State	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Asthma by State	0	0	0	0	0	79
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Cholesterol by State	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Visual Impairments by State	0	0	9	17	0	91
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Hearing Impairments by State	0	0	9	17	0	91
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Heart Attack by State	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
BRFSS: Stroke by State	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Department of Education: Sex by Type of Degree	1	1	34	40	30	8
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
FBI Crime Statistics: Sex by Crime Type	31	21	34	91	44	69
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
FBI Crime Statistics: Race by Crime Type	39	23	52	33	18	54
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Political View by Age	0	0	0	100	70	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Political View by Race	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Political View by Education	0	0	0	18	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Political View by Income	2	0	0	62	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Political View by Sex	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Party Affiliation by Age	0	0	0	0	14	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Party Affiliation by Race	0	0	27	5	51	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Party Affiliation by Education	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Party Affiliation by Income	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
GSS: Party Affiliation by Sex	0	0	0	25	95	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Department of Labor: Sex by Occupation	37	22	46	52	35	15
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Department of Labor: Race by Occupation	0	0	8	43	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Expenditure by Age Group	8	0	0	3	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Office-based Visits by Age Group	0	0	0	11	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Inpatient Visits by Age Group	19	0	0	6	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Dental Visits by Age Group	0	0	0	9	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Has Insurance by Age Group	85	87	88	51	30	85
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Expenditure by Race	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Office-based Visits by Race	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Inpatient Visits by Race	8	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Dental Visits by Race	0	0	0	7	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
MEPS: Has Insurance by Race	94	86	96	30	28	85
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NHANES: Age by BMI Group	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NHANES: Diabetes by BMI Group	0	41	60	26	0	70
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NHANES: Diabetes by Age Group	0	41	60	26	0	70
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NHANES: Weekly Alcohol Consumption by Age Group	28	8	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Alcohol Use in Last Month by Age	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Cigarette Use in Last Month by Age	0	76	0	0	0	86
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Marijuana Ever Used by Age	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Cocaine Ever Used by Age	11	0	0	0	0	43
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Heroin Ever Used by Age	2	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Alcohol Use in Last Month by Race	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Cigarette Use in Last Month by Race	NA	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Marijuana Ever Used by Race	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Cocaine Ever Used by Race	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
NSDUH: Heroin Ever Used by Race	0	0	0	0	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Food Expenditure by Age Group	0	0	0	2	0	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: House Ownership by Age Group	0	9	0	71	54	15
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Total Assets by Age Group	0	0	20	22	4	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Debt by Age Group	0	34	43	7	0	34
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Net Worth by Age Group	0	29	65	21	5	62
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Food Expenditure by Race	0	0	0	0	10	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: House Ownership by Race	16	0	0	74	76	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Total Assets by Race	0	1	12	23	2	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Debt by Race	0	20	41	8	0	34
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Net Worth by Race	0	29	54	23	3	62
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Food Expenditure by Education	0	0	9	0	27	7
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: House Ownership by Education	72	0	0	46	66	0
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Total Assets by Education	0	0	34	22	7	3
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Debt by Education	0	26	45	3	0	36
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
SCF: Net Worth by Education	0	17	46	26	3	72
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question:
Select Conditioning Value Question: