Benchmarks

EleutherAI: Llemma 7b

eleutherai/llemma_7b

Llemma 7b is a EleutherAI model that isn't ranked on the TryAii Score yet — no benchmark results on file. It lists at $0.8/$1.2 per million input/output tokens with a 4K-token context. It's on the slow side at about 4 tokens/sec.

Prompt $/1M
$0.800
Completion $/1M
$1.200
Context
4,096 tok
Best provider
4 tok/s · Featherless

Specs

Model id
eleutherai/llemma_7b
Display name
EleutherAI: Llemma 7b
Modality
text->text
Tokenizer
Other
Instruct type
code-llama
Context length
4,096
Max completion
4,096
Prompt $/1M
$0.800
Completion $/1M
$1.200
Free tier
no

Capabilities

  • Function callingno
  • JSON modeno
  • System promptyes
  • Visionno
  • Moderatedno

Benchmark scores

Each axis is one benchmark, normalized to the best model in the field.

No benchmark data for this model.

Speed by provider

Providertok/s
Featherlessfastest4
eleutheraifastest