Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models
Open paper
Benchmark
Model
Rank
Results
sentiment-analysis-on-imdb
OCaTS (kNN & GPT-3.5-turbo
#27
Accuracy: 93.06
Rank counts only results with a code link.