FEMS Project #3 — Streamlit Comparison Dashboard + 3-Backend Question Evaluation (Claude 9 / exaone 7 / gpt 7)
Put a Streamlit dashboard on top of FEMS RAG and threw the same question at 3 backends (exaone3.5:7.8b / claude-opus-4-8 / gpt-4o) simultaneously to compare. Q1 (air compressor anomaly in May) — exaone and gpt said 'no data', while Claude inferred 'weekend-hours anomaly' from summary stats alone without raw data + disclosed its limitations. Q2 (savings measures from a manager's perspective) — Claude 9/10 (incomplete due to token truncation), exaone 7/10 (broken index), gpt 7/10 (concise but hallucinated 'capacitor'). Results of 5-axis scoring.