I recently got hold of two RTX 3090 GPUs specifically for LLM inference and training. Everything seems to work well and I can finally fit a 70B model into the VRAM with 4 bit quantization. I am wondering if …

Nov 23, 2023 · Any ideas on how I can fit two air-cooled 3090s or 4090+3090 in O11 XL avoiding possible thermal throttling and affecting GPU lifespan? I am reluctantly open to buying a new case if …

Jun 20, 2023 · I was looking at all the benchmarks and although most of the 4xxx series cards are marginal improvements on 3xxx series, the 4090 looks to be anywhere from 50% to 80% …

Jul 7, 2023 · People seem to consider them both as about equal for the price / performance. I know 4090 doesn't have any more vram over 3090, but in terms of tensor compute according to the specs …

Jan 4, 2022 · I have a PNY 3090 Revel and I was never happy with the temps so I looked into undervolting. Didn’t realize how easy it is. I managed to settle with 1890mhz/850mv with a -270 core …

Sep 18, 2023 · I was reading on another subreddit about a gent (presumably) who added another 8GB chip to his EVGA 3070, to bring it up to 16GB VRAM. In the comments, people were discussing the …

Apr 3, 2022 · My 3090 ftw ultra doesn’t throttle until it hits 94c at gaming on max settings in hitting 86-92c been like this for over a year and card has been running fine. If temps are an issue you can …

May 16, 2023 · How many tokens per second do you guys get with GPUs like 3090 or 4090? (rtx 3060 12gb owner here)

Oct 11, 2021 · All things overclocking go here. Learn to overclock, ask experienced users your questions, boast your rock-stable, sky-high OC and help others!

Dec 15, 2022 · Upgrade from RTX 3090 Hey guys, hope you are doing fine So, I bought a 3090 for a very good price a month ago to my new build with an i7-13700kf, the doubt is, I mainly play the new …