Now available in preview, DeepSeek V4 cuts inference costs to a fraction of R1

Chinese AI darling DeepSeek is back with a new open weights large language model that promises performance to rival the best ...
Business Wire

Elasticsearch Open Inference API now Supports Jina AI Embeddings and Rerank Model

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, announced the Elasticsearch Open Inference API now supports Jina AI’s latest embedding models and reranking products.

Novita AI Ranked as the Best Performing & Reliable Inference Layer

As demand for open-source AI infrastructure grows, Novita AI is establishing itself as the inference provider for developers and engineering teams that need fast and affordable inference for ...
SiliconANGLE

OpenRouter nabs $40M in funding for its AI inference API

OpenRouter Inc., a startup working to ease the development of artificial intelligence applications, today announced that it has secured $40 million in funding. The company raised the capital over two ...
Business Wire

Elasticsearch Open Inference API and Playground Now Support Amazon Bedrock

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC) announced support for Amazon Bedrock-hosted models in Elasticsearch Open Inference API and Playground. Developers now have the flexibility to ...
Tencent

Tencent Unveils Hy3 preview; Model Enhances Agent Capabilities and Real-World Usability

Tencent today launched and open sourced the Hy3 preview model. It is a Mixture-of-Experts (MoE) model that integrates both ...
Nasdaq

Elasticsearch Open Inference API Extends Support for Hugging Face Models with Semantic Text

Applications using Hugging Face embeddings on Elasticsearch now benefit from native chunking “Developers are at the heart of our business, and extending more of our GenAI and search primitives to ...

Grath Launches Topa, a Managed Inference Platform for Financial Reconciliation

The company behind the Grath reconciliation platform introduces AI infrastructure for financial services teams building their ...
Bloomberg L.P.

The journey to build Bloomberg’s ML Inference Platform Using KServe (formerly KFServing)

This post details the beginning of Bloomberg’s journey to build a machine learning inference platform. For those readers who are less familiar with the technical concepts involved in machine learning ...