Measured model and hardware comparisons with methods, numeric results, and reproducibility details.
João Correia, Telmo Felgueira, Tiago Gonçalves, Bojan Jakimovski, Jim Burtoft, Louise Ping · August 18, 2026
A native PyTorch benchmark showing EvolutionaryScale ESMC-300M running on AWS Trainium2: 490.8 variants per second on a single trn2.3xlarge — approximately 42.4 million protein variants scored per day at approximately $1.26 per million, 60% below H100 in this fixed-shape D2Deep benchmark.
Nina Cvetkovska, Bojan Jakimovski · July 10, 2026
The main post covers what we found: Grok 4.3 lands in the same 96–97% accuracy band on GSM8K whether you reach it through Amazon Bedrock Mantle or the first-party xAI API, and low reasoning effort captures most of the…
Nina Cvetkovska, Bojan Jakimovski · July 10, 2026
A public-facing benchmark story on Grok 4.3 through Amazon Bedrock Mantle and the xAI API, focused on accuracy, latency, cost, reliability, and enterprise deployment tradeoffs.
Ervin Shaqiri, Alexandre Domingues · July 1, 2026
Fourteen open-source text-to-speech models across six emotion-control paradigms, benchmarked against AWS Nova Sonic v2 on naturalness, expressiveness, latency, and licensing.
Julián F. Fernández, Andres Florian, Daniel Sabogal · June 30, 2026
What to know before you scale cofolding jobs from five structures to ten thousand.
Petar Kalinovski, Bojan Jakimovski · June 15, 2026
The main post covers what we found: GPT-5.5 on Amazon Bedrock matches OpenAI API accuracy and comes out faster on every latency and throughput dimension we measured. This post covers how we ran it. If you want to…
Petar Kalinovski, Bojan Jakimovski · June 15, 2026
A comparison of GPT-5.5 through Amazon Bedrock and the OpenAI API across answer quality, latency, throughput, and reliability, followed by two production-shaped copilot builds.
Bojan Jakimovski, Loka Applied Research · May 21, 2026
A practical benchmark showing Hugging Face Bio Carbon running on AWS Trainium2 with NxD Inference, covering what worked, what we measured, and why it matters for bio and HCLS teams moving open models into production.
Bojan Jakimovski, Petar Kalinovski · February 23, 2026
An ablation-driven study of GRPO-style reinforcement learning with LoRA on Trinity Mini for biomedical relation extraction, covering the training choices that materially changed performance.
Romulo Pagnozzi, Crhistian Cardona · January 20, 2026
A practical benchmark of RAG ingestion and search performance across AWS Lambda and EC2
Crhistian Cardona, Bojan Jakimovski · April 10, 2025
A DeepSeek benchmark on AWS that compares cost, performance, and deployment choices for business workloads using open-weight models.