Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Q&A

Welcome to the Power Users community on Codidact!

Power Users is a Q&A site for questions about the usage of computer software and hardware. We are still a small site and would like to grow, so please consider joining our community. We are looking forward to your questions and answers; they are the building blocks of a repository of knowledge we are building together.

Comments on What's the maximum hit rate, if any, when using Claude, Gemini, Llama and Mistral via Google Cloud Compute?

Post

What's the maximum hit rate, if any, when using Claude, Gemini, Llama and Mistral via Google Cloud Compute?

+0
−5

What's the maximum hit rate, if any, when using Claude, Gemini, Llama and Mistral via Google Cloud Compute? (Example of maximum hit rate: 1M input tokens/minutes)

I don't use provisioned throughput.


I call Gemini as follows:

YOUR_PROJECT_ID = 'redacted'
YOUR_LOCATION = 'us-central1'
from google import genai
client = genai.Client(
 vertexai=True, project=YOUR_PROJECT_ID, location=YOUR_LOCATION,
)
model = "gemini-2.5-pro-exp-03-25"
response = client.models.generate_content(
 model=model,
 contents=[
   "Tell me a joke about alligators"
 ],
)
print(response.text, end="")
History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.
Why should this post be closed?

3 comment threads

Not a good fit for a Q&A site (2 comments)
If you cross-post the same question on multiple sites, you should include links to all other versions... (10 comments)
What have you tried? (2 comments)
If you cross-post the same question on multiple sites, you should include links to all other versions...
samcarter‭ wrote 4 days ago

If you cross-post the same question on multiple sites, you should include links to all other versions of the question in every post, even in the original one. X-posting without explicit links has the risk of wasting both the time of users who might put time and effort into answering a post, which already has an answer elsewhere, as well as the time of users who might have the same problem but can't find the solutions you might have gotten on one of the other sites you x-posted your question

Some users are downvoting me because I'm crossposting so I'm not going spend time listing crossposts anymore

Out of my 50 questions so far on this site, less than 10% received a useful answer but I've received way more non-answer comments. I just want to use Q&A, not all the other part.

samcarter‭ wrote 4 days ago

If the users of a site don't appreciate cross-posts, trying to hide the fact that they are cross-posts seems like a poor solution. This risks wasting the time of volunteers and the time of other users with the same problem.

samcarter‭ they can use Google. Finding dupes is easily automated.

samcarter‭ wrote 4 days ago

Someone, who volunteers their free time to help others, shouldn't have to first search in order to see if this is a cross-post.

samcarter‭ sounds like a platform issue

samcarter‭ I don't respect people who bury my posts with downvotes.

samcarter‭ I don't respect people who bury my posts with downvotes. I've been nothing but nice so far but evidently that's of no use so I won't spend my free time listing crossposts.