The PromptCards Tool "AInnotator" (artificial annotator) is an interactive web application that allows you to upload a dataset as a CSV file and apply a generative language model with a defined prompt for artificial annotation or zero-shot classification. You can access the tool here: https://huggingface.co/spaces/chkla/PromptCardsPlayground
The PromptCards Tool supports both open-source models and models from OpenAI. This flexibility enables you to experiment with various models and prompts to find the best combination for your specific task and dataset.
The tool also provides a way to validate the performance of such models by uploading a dataset with gold labels for the expected output and the predicted labels for a specific model. This allows you to compare and measure the accuracy and effectiveness of different models and prompts.