BengaliFig: Can AI Solve Culture-Rich Riddles?
Can AI grasp figurative language rooted in culture? BengaliFig puts it to the test for Bengali, a widely spoken yet low-resourced language.
This compact, carefully annotated challenge set gathers 435 riddles from Bengali oral and literary traditions and turns them into multiple-choice questions via a constraint-aware, AI-assisted pipeline.
- 5 annotation axes: reasoning type, trap type, cultural depth, answer category, difficulty
- Evaluates eight leading LLMs with zero-shot and few-shot chain-of-thought prompts
- Reveals consistent gaps in metaphorical and culturally specific reasoning
Why it matters: BengaliFig is both a diagnostic probe for LLM robustness in low-resource cultural contexts and a step toward inclusive, heritage-aware NLP evaluation.
By Abdullah Al Sefat. Read more: https://arxiv.org/abs/2511.20399v1
Paper: https://arxiv.org/abs/2511.20399v1
Register: https://www.AiFeta.com
#NLP #AI #Bengali #LowResource #LLM #CulturalAI #Benchmark #Riddles
