llm-mysteries

Highlights

Attempt 1

• Base lines are generated by main and main_gpt.

Attempt 2

• graph asks the LLM for exonerating and incriminating evidence for each suspect and symbolically combines the result.

Attempt 3

Inspired by LMs for Rationality,

• mystery transforms a belief graph into a MaxSAT problem to be optimized for debugging consistency;
• belief_graph elicits a belief graph for a story.

Libraries

Truth-Maintenance System

• tms is a basic probabilistic Truth-Maintenance System (TMS) with a MaxSAT backend.
  • tms_z3 is the Z3 backend.
  • tms_rc2 is the RC2 backend.
  • tms_mystery is mystery re-written to use the TMS.

Installation

In this repo

• git submodule init
• git submodule update

Python env

• pip install git+https://github.com/huggingface/transformers.git
• pip install "outlines @ git+https://github.com/outlines-dev/outlines.git@main"
• pip install z3-solver
• pip install python-sat