AI Updates
  • Latest News
  • Models & Research
    • AGI & Alignment
    • AI Agents
    • Foundation Models
    • Generative AI
    • Open Source AI
    • Research & Papers
    • Rankings & Benchmarks
  • Infrastructure
    • Chips & Semiconductors
    • Cloud & Networking
    • Data Centers & Neoclouds
    • Developer Platforms
    • Quantum Computing
  • Business
    • Big Tech Strategy
    • Mergers & Acquisitions
    • Public Markets
    • Startups & Funding
    • Talent & Leadership
    • Market Analysis
  • Applications
    • Consumer & Creative
    • Cybersecurity
    • Education & Media
    • Enterprise & Productivity
    • Finance & Legal
    • Healthcare & Life Sciences
    • Industry & Manufacturing
    • Science & Discovery
  • Robotics
    • Autonomous Vehicles
    • Drones & Defense
    • Edge AI & Embodied Intelligence
    • Robotics
  • Energy
    • Cooling & Water
    • Efficiency & Emissions
    • Electricity & Power Grids
    • Nuclear & Renewables
  • Policy & Society
    • AI Safety & Security
    • Copyright & Misinformation
    • Geopolitics
    • Privacy & Human Rights
    • Regulation & Government
    • Work & Society
Stay Ahead of AI

Get the AI developments that matter, delivered to your inbox.

Follow AI Updates
Facebook
Twitter
Instagram
  • Home
  • About
  • News
  • Contact
  • Newsletter
0
0
0
AI Updates AI Updates
AI Updates
  • Latest News
  • Models & Research
    • AGI & Alignment
    • AI Agents
    • Foundation Models
    • Generative AI
    • Open Source AI
    • Research & Papers
    • Rankings & Benchmarks
  • Infrastructure
    • Chips & Semiconductors
    • Cloud & Networking
    • Data Centers & Neoclouds
    • Developer Platforms
    • Quantum Computing
  • Business
    • Big Tech Strategy
    • Mergers & Acquisitions
    • Public Markets
    • Startups & Funding
    • Talent & Leadership
    • Market Analysis
  • Applications
    • Consumer & Creative
    • Cybersecurity
    • Education & Media
    • Enterprise & Productivity
    • Finance & Legal
    • Healthcare & Life Sciences
    • Industry & Manufacturing
    • Science & Discovery
  • Robotics
    • Autonomous Vehicles
    • Drones & Defense
    • Edge AI & Embodied Intelligence
    • Robotics
  • Energy
    • Cooling & Water
    • Efficiency & Emissions
    • Electricity & Power Grids
    • Nuclear & Renewables
  • Policy & Society
    • AI Safety & Security
    • Copyright & Misinformation
    • Geopolitics
    • Privacy & Human Rights
    • Regulation & Government
    • Work & Society
A developer comparing model performance and cost controls on a clean workstation
  • Developer Platforms

OpenAI Cuts API Costs and Refreshes Its Developer Model Stack

  • January 26, 2024
  • No comments
Total
0
Shares
0
0
0
0

OpenAI announced a coordinated update to the services developers use around its language models. The release introduced two new embedding models, an updated GPT-4 Turbo preview, a stronger moderation model and more detailed controls for API keys. It also reduced prices for embeddings and planned another cut for GPT-3.5 Turbo.

Taken together, the changes show how an AI platform competes after models become widely available. Model quality still matters, but developers also choose providers based on unit cost, safety tooling and the ability to operate several products from one account. OpenAI’s update addressed each of those concerns rather than relying on a single headline model.

New Embeddings Improve Retrieval at Lower Cost

Embeddings convert text into numerical representations that applications can use to compare meaning, search documents and retrieve relevant context. OpenAI introduced text-embedding-3-small and text-embedding-3-large as successors to text-embedding-ada-002. The large model reached average scores of 54.9 percent on MIRACL and 64.6 percent on MTEB, compared with 31.4 and 61 percent respectively for the older model.

The small model’s price fell to $0.00002 per thousand tokens, one fifth of the older model’s $0.0001 price. OpenAI also said developers could shorten embeddings to reduce storage and processing costs without a large accuracy penalty. That flexibility matters because an application may store vectors for millions of passages. The best choice is not automatically the highest benchmark score; teams can test whether a smaller model or shortened vector preserves enough retrieval quality for their specific documents.

GPT Pricing Targets Production Workloads

OpenAI planned to release an updated GPT-3.5 Turbo and cut input prices by 50 percent and output prices by 25 percent. It was the third price reduction for the model in a year, demonstrating how quickly the economics of a mature API can change. Lower input prices can be particularly important for applications that repeatedly send instructions, conversation history or retrieved documents with every request.

The company also updated the GPT-4 Turbo preview to `gpt-4-0125-preview`. OpenAI said more than 70 percent of GPT-4 API requests had moved to the Turbo model since its introduction. The refresh was intended to complete code-generation and other tasks more thoroughly, addressing cases where the model failed to finish what a user requested. Preview identifiers help developers select a specific version, but they also create work: every model change should be tested against existing prompts before it becomes a production default.

Moderation and API Controls Support Larger Teams

The new text-moderation-007 model was described as OpenAI’s most advanced moderation system at the time, with improved detection of potentially harmful text. A platform-level classifier can give developers a consistent starting point for screening input and output. It does not remove the need for application-specific rules, since acceptable content differs between a general writing tool, an educational service and a high-risk public forum.

OpenAI also added the ability to assign permissions to individual API keys and inspect usage per key. These operational changes may attract less attention than a model launch, but they are essential for teams running several products. Restricted keys can limit the damage caused by accidental exposure, while per-key metrics help identify which application is driving cost. Organisations should still rotate secrets, separate environments and alert on unusual activity, but the platform controls make those practices easier to implement.

Platform Value Comes From the Whole Stack

The release combines better model performance with lower cost and stronger administration. This creates a reinforcing effect. Cheaper inference encourages more experiments, improved embeddings make retrieval applications more capable and better key controls help teams move those experiments into managed environments. Moderation support then provides a common safety layer for products that reach users.

There are trade-offs behind the bundle. Lower prices can increase total spending if usage grows faster than unit cost falls. A stronger embedding model can improve average retrieval while still failing on a company’s specialised terminology. Automated moderation can miss harmful meaning or block legitimate material. The right response is measurement rather than blind adoption: teams should maintain evaluation sets, monitor cost per useful outcome and document which model version each service uses.

The updated API also highlights the importance of migration planning. When a provider introduces new model names and preview versions frequently, developers need a controlled process for comparison and rollback. A small quality change can affect downstream workflows, especially when model output is parsed by software rather than read by a person. Price announcements should therefore prompt both a financial review and a regression test.

OpenAI said further improvements were planned for larger development teams. The direction is visible in this release: permissions, observability and safer defaults are becoming part of the core product. As AI moves from individual prototypes to portfolios of internal and customer-facing services, those platform capabilities can be as decisive as benchmark performance.

For developers, the immediate opportunities are concrete. They can compare the new embedding models with existing search quality, estimate the effect of the GPT-3.5 price reductions and trial the GPT-4 Turbo preview on difficult completion tasks. They can also tighten key permissions and separate usage reporting by project.

The larger lesson is that AI infrastructure is maturing. Providers are no longer selling only access to a model; they are selling a development environment with economics, controls and safety services. OpenAI’s update strengthens that environment by reducing friction at several points. Whether it produces better products will depend on how carefully teams test and govern the new choices.

Views: 81
Total
0
Shares
Share 0
Tweet 0
Pin it 0
Share 0
Topics
  • API
  • Embeddings
  • GPT-4 Turbo
  • Moderation
  • OpenAI
Previous Article
A software team following a clear development and security workflow
  • Developer Platforms

GitLab Duo Brings AI Across the DevSecOps Lifecycle

  • November 13, 2023
View Post
Next Article
Multimodal developer API analysing an image interface sketch and long document
  • Developer Platforms

GPT-4 Turbo With Vision API Moves Into General Availability

  • April 10, 2024
View Post

Stay Ahead of AI

Get the AI developments that matter, delivered to your inbox.

More AI News
AI-generated conceptual illustration of an unbranded autonomous test sedan with a safety operator, not an actual Pony.ai vehicle or operating service
View Post
  • 3 min
  • Autonomous Vehicles

inDrive’s Kazakhstan Robotaxi Plan Begins With a Feasibility Test

  • October 23, 2026
AI-generated fictional gathering of women learning with laptops, not the real Aged Intelligence Society or its founders
View Post
  • 3 min
  • Work & Society

Aged Intelligence Society Makes AI Learning a Shared Exercise

  • October 23, 2026
AI-generated fictional clinician reviewing abstract diagnostic research materials, not a real patient or clinical trial
View Post
  • 3 min
  • Healthcare & Life Sciences

Microsoft’s New Diagnostic Results Face a Real-World Test

  • October 23, 2026
AI-generated conceptual brass key connecting separate cloud compartments, not an actual network diagram
View Post
  • 3 min
  • Cybersecurity

ConnectWise Incident Shows Why AI Attack Counts Need Context

  • October 23, 2026
AI-generated fictional office team reviewing abstract computer output, not actual Uber employees or premises
View Post
  • 3 min
  • Enterprise & Productivity

Uber Expands ChatGPT Work, With Outcomes Still to Be Measured

  • October 23, 2026
AI-generated conceptual collage of a record connected to blank devices, illustrating distribution through AI agents
View Post
  • 3 min
  • Business & Markets

Spotify Bets on AI Agents as a Distribution Channel

  • October 23, 2026
AI-generated conceptual server illustration showing an intrusion trail predating a protective update, not an actual affected system
View Post
  • 3 min
  • Cybersecurity

AWS Finds PHP Attack Attempts Before Public Disclosure

  • October 22, 2026
AI-generated fictional California technology-company boardroom and campus, not Meta's actual premises
View Post
  • 3 min
  • Big Tech Strategy

Meta Links Its Non-Voting Share Plan to Founder Leadership

  • October 22, 2026

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Subscribe

Subscribe now to our newsletter

AI Updates
  • About
  • Newsletter
  • Contact
  • Privacy Policy
  • Terms of Use
Artificial Intelligence News

Input your search keywords and press Enter.

Go to mobile version