Serving, runtime, latency, throughput, and deployment engineering for generative and scientific models.
Nina Cvetkovska, Bojan Jakimovski · July 10, 2026
The main post covers what we found: Grok 4.3 lands in the same 96–97% accuracy band on GSM8K whether you reach it through Amazon Bedrock Mantle or the first-party xAI API, and low reasoning effort captures most of the…
Nina Cvetkovska, Bojan Jakimovski · July 10, 2026
A public-facing benchmark story on Grok 4.3 through Amazon Bedrock Mantle and the xAI API, focused on accuracy, latency, cost, reliability, and enterprise deployment tradeoffs.
Ervin Shaqiri, Alexandre Domingues · July 2, 2026
In the digital audio subset of AI, the questions currently on everyone’s mind are
Ervin Shaqiri, Alexandre Domingues · July 1, 2026
Fourteen open-source text-to-speech models across six emotion-control paradigms, benchmarked against AWS Nova Sonic v2 on naturalness, expressiveness, latency, and licensing.
Julián F. Fernández, Andres Florian, Daniel Sabogal · June 30, 2026
What to know before you scale cofolding jobs from five structures to ten thousand.
Petar Kalinovski, Bojan Jakimovski · June 15, 2026
The main post covers what we found: GPT-5.5 on Amazon Bedrock matches OpenAI API accuracy and comes out faster on every latency and throughput dimension we measured. This post covers how we ran it. If you want to…
Petar Kalinovski, Bojan Jakimovski · June 15, 2026
A comparison of GPT-5.5 through Amazon Bedrock and the OpenAI API across answer quality, latency, throughput, and reliability, followed by two production-shaped copilot builds.
Bojan Jakimovski, Loka Applied Research · May 21, 2026
A practical benchmark showing Hugging Face Bio Carbon running on AWS Trainium2 with NxD Inference, covering what worked, what we measured, and why it matters for bio and HCLS teams moving open models into production.
Bojan Jakimovski · May 21, 2026
Hugging Face Bio’s Carbon release is interesting for two reasons at once. First, it is a biology model. Second, it is not an infrastructure outlier. Many genomic models come with custom architectures, specialized…
Romulo Pagnozzi, Crhistian Cardona · January 20, 2026
A practical benchmark of RAG ingestion and search performance across AWS Lambda and EC2
Crhistian Cardona, Bojan Jakimovski · April 10, 2025
A DeepSeek benchmark on AWS that compares cost, performance, and deployment choices for business workloads using open-weight models.
Crhistian Cardona, Bojan Jakimovski · February 20, 2025
A deployment walkthrough for serving distilled DeepSeek-R1 models with Amazon SageMaker AI, including the AWS setup for open-weight reasoning models.
Crhistian Cardona, Bojan Jakimovski · February 20, 2025
Engineering notes on deploying DeepSeek-R1 models to AWS-designed silicon instances and serving open-weight reasoning models on AWS.