Skip to content

taco-group/MapBench

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MapBench

📦 Installation

Create the environment with the provided dependencies:

conda env create -f environment.yml

🚀 Inference with GPT

Run inference using your selected GPT model:

python infer_gpt.py \
    --save-dir ./outputs \               # Directory to save results
    --api-key <your-api-key> \           # Your OpenAI API key
    --gpt-model gpt-4o-mini-2024-07-18   # GPT model to use

💡 Replace with your actual OpenAI API key.

📊 Evaluation

Evaluate the model-generated results:

python eval.py \
    --result-file ./outputs/google_map.jsonl \  # Path to the result file
    --log-dir ./logs                            # Directory to save evaluation logs

📝 The log file will have the same name as the result file.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages