Hacker News

armcat
OpenAI models are coming to Google Cloud openai.com

anthonypasqan hour ago

Sergey better really go into "founder mode" or else Thomas Kurian (head of GCP) will continue to eat Deepmind's lunch.

Between selling TPUs to external companies and now hosting competitor models, Gemini just doesnt have the full faith of the Alphabet capital allocators, and I can't really blame them. A mature company like google would rather just expand their extremely profitable cloud business rather than dump billions into a black hole on the off chance they achieve RSI or superintelligence or whatever.

hax0ron328 minutes ago

Google uses Gemini for its AI Overview on Google Search results, though. And it seems to me that this is an area where they really have a big incentive to run their own AI that they completely control. AI Overview sits at the top of the Google Search results first page, so when it comes to marketing it's sitting in the most coveted place on the entire Internet.

kenhwang21 minutes ago

It's also marketing that their AI is hilariously terrible because AI Overview is the biggest posterchild for AI slop and often used as an example of how bad Google is at AI. Gemini proper isn't that bad, just the ultra cost cutting version on search is.

sebzim450017 minutes ago

To be fair the search version of Gemini is nowhere near as bad as it used to be. The bar is in the floor I know.

nsagent4 hours ago

Gotta love the disclaimer at the bottom:

  Microsoft remains OpenAI’s primary cloud partner.

hobofan3 hours ago

Things that you only say because you are contractually forced to say them.

merelydev3 hours ago

Or don't want to crash stock price.

echelon2 hours ago

OpenAI buys from Azure because of the Microsoft investment deal.

OpenAI sells and reaches enterprise customers via GCP.

Enterprises want zero data retention guarantees and they're already on AWS or GCP, so this is how OpenAI reaches those customers and makes more money.

_boffin_an hour ago

Microsoft has had ZDR for inference since pretty much the beginning. Just needed to fill out a form and get approved.

keerthiko2 hours ago

isn't the largest portion of openAI's reach to (overwhelming cloud provider leader AWS) enterprise customers via amazon bedrock?

paxyan hour ago

OpenAI only launched on bedrock ~3 months ago, so I doubt it. It has been running on azure since day 1.

londons_explore2 hours ago

> Enterprises with Google Cloud spend commitments will be able to draw down their GCP commitments for these purchases.

This is a fairly big move by Google... It means revenue they have already booked and reported to shareholders they now might have to give away - potentially all of it. Bean counters hate that!

paxyan hour ago

“Reported to shareholders” doesn’t really mean anything. There are thousands of such line items on financial reports. The ones that matter, such as recognized revenue, don’t count future bookings. It is understood that customers renege on these commitments all the time.

Google is simply telling customers - there’s a new Google Cloud service, and you can use it under your existing account.

TiredOfLife9 minutes ago

And Google is renting compute from SpaceX.

123haw3 hours ago

Preparing for Oracle bankruptcy.

kpsan hour ago

There's always a silver lining!

essephan hour ago

I could only hope...

bananzamba3 hours ago

How are they trusting Google not to destill them

dumberquestions3 hours ago

This is speculation, but funnily enough Gemini models show the least evidence of being distilled from OAI or Anthropic compared to everything else in the market.

BudaDude2 hours ago

I feel this is correct. Google has probably the most data of any company in the world. For better or worse, they don't need to train on the outputs of other models.

iamdelirium3 hours ago

GCP already hosts Anthropic models so probably trusts and lawyers.

aviinuo3 hours ago

Nvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live

zeroxfe2 hours ago

Distillation does not require access to weights.

jayd162 hours ago

Isn't distillation more of a black box type affair?

binlog3 hours ago

Doesn’t really matter what happens at the GPU level when Google can see all API traffic.

worldsavior3 hours ago

Except google cloud doesn't use Nvidia GPUs but TPUs.

Mond_an hour ago

Google has both. Afaik we don't know whether OpenAI models will run on TPUs or GPUs here.

tgmaan hour ago

I bet it would be the NVIDIA, at least initially, not for the encryption capability per se, but for simple fact that adapting to TPU at high performance is non-trivial.

lrvick3 hours ago

Probably a very strict contract, and letting OpenAI read all the session logs like they do for their own customers.

tgma2 hours ago

America is a high-trust society.

toephu239 minutes ago

Japan is a high-trust society. America is the opposite.

tgma35 minutes ago

Everything is relative, but fair enough.

paxy2 hours ago

More like - America is a high-litigation society.

tgmaan hour ago

I don't believe threat of litigation alone explains the extent of it.

The way an American company, esp a reputable one like Google, conducts itself internally is different. There will be much more internal backlash to do the wrong thing way before litigation.

amelius2 hours ago

First answer this: How are they trusting OpenRouter not to distill them?

WarmWash3 hours ago

Google Cloud couldn't give a shit about Google Deepmind, and backdooring Clouds customers only stands to hurt Cloud.

binlog3 hours ago

Contracts and lawyers are more powerful than any technical tool.

amelius2 hours ago

Yeah like the copyright lawyers of content owners that got their works trained on?

paxyan hour ago

How many trillions of dollars were those content owners worth?

kridsdale1an hour ago

Enough. They just weren’t working in coordination.

[deleted]2 hours agocollapsed

game_the0ry2 hours ago

Prediction: google cloud will pivot to being a hyperscaler versus a model + hyperscaler. Kind of like how xAI started hosting anthropic workloads with colossus cluster.

bc the alpha is not the model, the alpha is having the physical infra (chips, power, etc).

hackernudes2 hours ago

But x.ai also hosts Grok? Why would google stop developing their own models? I think you're right that Google will try to make money from their infrastructure (that's basically what Google Cloud is too).

ReptileManan hour ago

As much as I like Elon, if Grok was a hero shooter its concurrent steam player count will be in low hundreds.

paxyan hour ago

A company is allowed to do two things

barumrho2 hours ago

Is that a long term prediction? Are you saying that physical infra will always lag demand from here on?

cmaan hour ago

>Kind of like how xAI started hosting anthropic workloads with colossus cluster.

Google has been hosting part of Anthropic's load long before that deal. They had a big degradation due to compiler bug for TPUs in an optimization they made to work around TPUs not being able sample from the logits efficiently.

AznHisoka2 hours ago

Does this mean OpenAI is going to use TPU now?

AndrewKemendo3 hours ago

We need a new acronym

Google, NVIDIA, OpenAI, MSFT…

GNOM…oh wait no

The strategy that I’ve heard said out loud now by all the major technology companies is “we’re all doing it (AI) together”

In my view this was more or less the political result of the White House summit

So I think we’re seeing what is basically going to be a giant amorphous set of collaborations such that nobody gets taken down, and the whole market doesn’t collapse

If Alphabet, OAI, MSFT, AMZ…etc all agree to be interoperable then they will be acting more or less as a single body in tension.

Whether that’s good or not is a question of your worldview but I think that’s the strategy

simonw2 hours ago

Add Anthropic and you get MANGO. MSFT, Anthropic, NVIDIA, Google, OpenAI.

AndrewKemendo2 hours ago

Let’s go with Mango!

paxy2 hours ago

Giant companies working together isn’t an AI-age phenomenon. Go back 10, 20, 30 years and you’ll see that despite the public perception of competitiveness all the largest tech companies (Apple, Microsoft, Google, Samsung, Amazon) buy/sell to each other, sign partnerships and have tight economic interdependencies.

AndrewKemendo2 hours ago

Who said it’s new? :)

However if you look at the trust busting era what preceded it was this exact kind of private “cooperation” to prevent government involvement

selimthegrim3 hours ago

This is like that SNL skit with Tim Meadows where Will Ferrell has the F on his shirt on the kids TV show and keeps getting in the inappropriate order

solyin2 hours ago

Add in Meta (Muse app is a winner)

MOM-NG GNOMM NGMOM MGNOM MGMNO MGMON ONMGM NOMGM NOMMG

cubefox3 hours ago

Is this the begging of the end of Gemini?

tancop2 hours ago

Why would it? The point of Gemini is provide user facing services cheaper than if they were paying OpenAI, make some money on the side with API credits and position themselves as a leader when investors want to see AI everywhere.

Google Cloud is competing with AWS. Amazon has Bedrock so Google needs to keep up with them by serving both Claude and GPT, along with Gemini and open models.

iamdelirium3 hours ago

GCP has been hosting Anthropic models for a while.

cubefox2 hours ago

Google owns Anthropic stock.

dgellow3 hours ago

No? Why would you think that’s the case? Gemini fills its own niche

cubefoxan hour ago

Gemini and GPT fill the same niche. They are direct competitors.

lemonish972 hours ago

"OpenAI models will soon be available in the Gemini Agent"

They definitely need to have a better name if they're going to use 3p models

torben-friisan hour ago

New to Google?

open5923 hours ago

I don't understand all the wild speculation and question here - openai is selling a shit ton of inference through third parties. these third parties want to provide inference to their customers who use gcp (and don't want to also inference through bedrock or azure ai foundary.

these are all zdr engagements and thus "enterprise" contracts.

basically it boils down to - anthropic already provides inference direct through GCP, Azure, and AWS - so to compete openai is doing the same.

hn-front (c) 2024 voximity
source