Project Overview
When users encounter claims such as “this supplement prevents disease” or “this remedy works in three days,” they usually want a quick answer: can I trust it? A general-purpose AI can provide a verdict, but often leaves users unsure which evidence matters, where the reasoning breaks, or what to do when the next claim appears. Insight AI is an AI product for evaluating health information. It helps users check the claim in front of them and turns the reasoning process into short, practical exercises so they can build a reusable judgment method. I independently own the product positioning, needs analysis, core features, Agent workflow, prototype design, and product-validation plan.
Pain Points & Opportunities
The target users regularly encounter health content on social platforms, care about making sound decisions, and lack specialist medical knowledge. They face three connected problems: they do not know whether a claim deserves trust; even after seeing a verdict, they cannot tell which sources, evidence, or reasoning are reliable; and they remain dependent on someone else when the next similar claim appears. Conventional fact-checking and general AI answers usually solve only the first problem and explain every claim in the same way. Yet one user may be influenced by expert-like authority cues while another responds more strongly to emotion, data presentation, or a persuasive causal story. The product opportunity is to connect “check the current claim,” “practice the method,” and “track personal weak spots” in one experience.
Goals & Metrics
The product has three levels of value. Immediate value: help users assess a health claim faster and understand where the evidence comes from. Capability value: help users state the basis for their judgment and reuse the method on unfamiliar content. Long-term value: remember which judgment dimensions a user tends to miss and recommend practice at the right level. Product validation will track judgment accuracy, completeness of reasoning, willingness to share, confidence, and follow-up practice completion. These are target measures for validation, not completed performance improvements.
User Research
The real job to be done is not “decide whether this one claim is true for me,” but “help me quickly judge whether a health claim is credible and know how to verify it next.” I translated common difficulties into five product dimensions: source and credentials, evidence quality, causal reasoning, data presentation, and emotional or risk framing. The experience must do two things well: immediately show users which signals they noticed or missed, and let them apply the same method to new content instead of merely reading an explanation. This led Insight AI away from a one-turn Q&A and toward a product structure combining real-claim checks, guided practice, and progress review.
Solution Design
The product offers three entry points. Quick Check lets users paste a real health claim and receive source checks, evidence grading, reasoning breakdowns, and suggested verification steps. Guided Practice presents a controlled health-information scenario: users rate credibility and explain why, mark suspicious signals, receive immediate feedback, complete a rewrite, rebuttal, or verification-path task, and then apply the method to a new scenario. Progress Review summarizes judgment dimensions the user frequently misses and recommends the next practice session. A complete practice loop is “initial judgment → explain the reason → identify a weak spot → practice in a short scenario → receive instant feedback → apply the method to new content → update the profile and review suggestion.” Understanding, Retrieval, Reasoning, and Reflection support this flow behind the scenes; users experience a coherent task rather than a technical pipeline.
Execution Plan
The MVP focuses on the shortest useful path: enter a health claim → record the user’s initial judgment and confidence → retrieve trusted material → explain the evidence and reasoning issue → complete one transfer exercise → collect feedback. The first version covers quick checks, evidence explanation, short scenario practice, and basic weak-spot tracking. Progress trends, automatic review, and expansion beyond health content come later. LangChain orchestrates the workflow, Prompt Engineering controls questions, hints, and feedback structure, Chroma with DashScope Embedding supports retrieval, and FastAPI plus React provide the service and interaction layers. Coze is used to validate selected flows quickly. RAG does not make the final decision for the user; it gives every explanation a traceable evidence base.
Results Review
Work completed so far includes the product positioning, target-user and job definition, three product modes, core usage loop, five judgment dimensions, four-layer Agent model, grounded RAG flow, and a prototype plan ready for further validation. The next product-validation phase will compare personalized practice, a standard AI answer, and an unguided experience. It will assess whether users judge more accurately, explain their reasoning more clearly, share more cautiously, and reuse the method in a new scenario. The project remains in progress, so this page does not present those outcomes as already achieved.
Iteration Reflection
Three product areas still need refinement. First, the weak-spot profile currently depends on explicit choices and answers; future versions should update it from real usage behavior with less setup effort. Second, the practice path is primarily rule-matched and should eventually adapt task difficulty, hint strength, and scenario type to performance. Third, a correct answer immediately after practice does not prove that the method will last; short review sessions and delayed check-ins are needed. My product roadmap is to make “quick check + evidence explanation + one practice task” work smoothly for health information first, then add progress review, proactive refreshers, and browser or social-information scenarios.