A sample is rising within the AI infrastructure world: widespread open supply instruments are remodeling into venture-backed startups price a whole bunch of hundreds of thousands of {dollars}. The newest instance is RadixArk, the industrial firm behind SGLang, an more and more widespread device that helps AI fashions run sooner and cheaper.
RadixArk was not too long ago valued at about $400 million in a funding spherical led by Accel, based on two folks accustomed to the matter, a notable quantity for a startup that was solely introduced final August. TechCrunch couldn’t verify the scale of the funding.
The information comes as a number of the crew liable for sustaining SGLang, which is utilized by firms like xAI and Cursor to speed up AI mannequin coaching, has transitioned to the not too long ago launched industrial startup. RadixArk originated as SGLang in 2023 contained in the UC Berkeley lab of Databricks co-founder Ion Stoica.
The startup beforehand raised angel capital from traders, together with Intel CEO Lip-Bu Tan, the folks mentioned.
Ying Sheng, a key contributor to SGLang and a former engineer at xAI, left Elon Musk’s AI startup to develop into the co-founder and CEO of RadixArk, based on a LinkedIn announcement she made final month. Sheng was beforehand a analysis scientist at Databricks.
RadixArk’s Ying Sheng, Accel, and Lip-Bu Tan didn’t reply to a request for remark.
Each SGLang and RadixArk deal with optimizing inference processing — primarily permitting fashions to run sooner and extra effectively on the identical {hardware}. Along with mannequin coaching, inference represents a big portion of the server prices related to AI companies. Consequently, instruments that optimize the method can create monumental financial savings nearly instantly.
Techcrunch occasion
San Francisco
|
October 13-15, 2026
RadixArk isn’t alone in making this transition from open supply mission to well-funded startup. vLLM, a extra mature mission for optimizing inference, has additionally made the leap. The newly shaped firm has had conversations about elevating upwards of $160 million in funding at a valuation of about $1 billion, Forbes reported final month.
Three folks accustomed to that deal inform TechCrunch that Andreessen Horowitz is main the funding into vLLM, although the ultimate numbers of that funding stay to be seen. Andreessen Horowitz declined to remark. vLLM co-founder Simon Mo characterised the details about this spherical “factually inaccurate” in a press release to TechCrunch, although he declined to specify which particulars have been incorrect.
Like SGLang, vLLM was incubated in Ion Stoica’s lab at UC Berkeley. Stoica, a professor at UC Berkeley, is the famed co-founder of Databricks in addition to quite a few different startups.
A number of giant tech firms already run their inference workloads utilizing vLLM, and SGLang has additionally gained important recognition during the last six months, Brittany Walker, a basic companion at CRV, instructed TechCrunch. Her agency didn’t again both firm.
RadixArk is continuous to develop SGLang as an open supply AI mannequin engine. The startup can be constructing Miles, a specialised framework designed for reinforcement studying, which permits companies to coach AI fashions to develop into smarter over time.
Whereas most of its instruments stay free, RadixArk has began charging charges for internet hosting companies, an individual accustomed to the corporate instructed TechCrunch.
Startups offering inference infrastructure for builders have seen a surge in funding in latest months, underscoring the continued significance of the inference layer for AI. Baseten not too long ago secured $300 million at a $5 billion valuation, The Wall Road Journal reported on Tuesday. This follows an identical transfer by rival Fireworks AI, which raised $250 million at a $4 billion valuation final October.
Trending Merchandise
