Dixhsa Hub
A resource hub of Zapotec learning materials. Launch expected in May 2025. 
Posts by Collection
portfolio
publications
Mothman at SemEval-2024 Task 9: An Iterative System for Chain-of-Thought Prompt Optimization
Published in Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), 2024
Extensive research exists on the performance of large language models on logic-based tasks, whereas relatively little has been done on their ability to generate creative solutions on lateral thinking tasks. The BRAINTEASER shared task tests lateral thinking and uses adversarial datasets to prevent memorization, resulting in poor performance for out-of-the-box models. We propose a system for iterative, chain-of-thought prompt engineering which optimizes prompts using human evaluation. Using thisshared task, we demonstrate our system’s ability to significantly improve model performance by optimizing prompts and evaluate the input dataset
Recommended citation: Alvin Po-Chun Chen, Ray Groshan, and Sean von Bayern. 2024. Mothman at SemEval-2024 Task 9: An Iterative System for Chain-of-Thought Prompt Optimization. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), pages 1876–1888, Mexico City, Mexico. Association for Computational Linguistics.
Download Paper
talks
Bind It All Together
Published:
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.