Google Says “We Have No Moat, And Neither Does OpenAI”
Rate this post
Key Points
The leaked document is titled “We Have No Moat, And Neither Does OpenAI.”
It argues that open-source AI development is winning and that Google and other companies have no competitive advantage or “moat” in the field.
The document suggests that Google and other companies should focus on building tools and infrastructure that support open-source AI development rather than trying to compete with it.
The document provides a fascinating insight into the state of AI development and the challenges facing companies like Google as they try to stay ahead of the curve.
Open-source development is unstoppable and has never been more alive!
Diving Into the Document
A leaked Google document titled “We Have No Moat, And Neither Does OpenAI” has recently garnered attention. Shared anonymously on a public Discord server, the document comes from a Google researcher and offers a frank analysis of the AI development landscape.
The document contends that open-source AI development is prevailing, leaving Google and other companies without a competitive edge.
Considering Google’s status as an AI leader and its substantial investments, this is a notable claim.
Quote: “But the uncomfortable truth is, we aren’t positioned to win this arms race and neither is OpenAI. While we’ve been squabbling, a third faction has been quietly eating our lunch.”
Here are some interesting developments in the open-source community:
Offline Fast LLMs: As reported in a recent Finxter article, many large language models can now be run offline. A Twitter user even shared how he ran a foundation model on a Pixel 6 at 5 tokens per second speed!
Scalable Personal AI: Projects like Alpaca-Lora allow you to fine-tune a personalized AI on your notebook in a couple of hours.
Multimodality: Researchers release new multimodal models that are trained in less than one hour and are freely available via GitHub. Here‘s the paper.
Responsible Release: You can find a list of pre-trained LLMs for textual data generation on myriads of new websites. Other websites now share generative art models, generated by Midjourney or DALL-E, without restrictions. See an example here:
The researcher suggests that instead of competing with open-source AI, Google and other companies should concentrate on creating tools and infrastructure to support it. This strategy would ensure rapid AI advancements and widespread benefits.
Check out this wonderful analysis from the article:
Quote: “Many of the new ideas are from ordinary people. The barrier to entry for training and experimentation has dropped from the total output of a major research organization to one person, an evening, and a beefy laptop.”
The leak has sparked significant debate within the AI community, with some criticizing Google for not adequately supporting open-source AI and others lauding the company for recognizing its own limitations.
LoRA works by simplifying model updates, making them much smaller and faster to process. This allows us to improve a language model quickly on regular computers, which is great for adding new and diverse information in real-time. Even though this technology could help Google’s ambitious projects, it’s not used enough.
Retraining models from scratch is difficult and time-consuming.
LoRA is effective because it can be combined with other improvements, like instruction tuning. These improvements can be added on top of each other to make the model better over time without needing to start from scratch.
This means that when new data or tasks become available, the model can be updated quickly and cheaply. On the other hand, starting from scratch wastes previous improvements and becomes very expensive.
We should think carefully about whether we need a new model for every new idea. If we have major improvements that make reusing old models impossible, we should still try to keep as much of the previous model’s abilities as possible.
I couldn’t resist adding this interesting quote from the article:
Quote: “LoRA updates are very cheap to produce (~$100) for the most popular model sizes. This means that almost anyone with an idea can generate one and distribute it. Training times under a day are the norm. At that pace, it doesn’t take long before the cumulative effect of all of these fine-tunings overcomes starting off at a size disadvantage. Indeed, in terms of engineer-hours, the pace of improvement from these models vastly outstrips what we can do with our largest variants, and the best are already largely indistinguishable from ChatGPT. Focusing on maintaining some of the largest models on the planet actually puts us at a disadvantage.”
Timeline of LLM Developments (Overview)
Feb 24, 2023 – Meta launches LLaMA, an open-source code with various model sizes.
March 3, 2023 – LLaMA is leaked, allowing anyone to experiment with it.
March 12, 2023 – Artem Andreenko runs LLaMA on a Raspberry Pi.
March 13, 2023 – Stanford releases Alpaca, enabling low-cost fine-tuning of LLaMA.
March 18, 2023 – Georgi Gerganov runs LLaMA on a MacBook CPU using 4-bit quantization.
March 19, 2023 – Vicuna, a cross-university collaboration, achieves “parity” with Bard at $300 training cost.
March 25, 2023 – Nomic creates GPT4All, an ecosystem for models like Vicuna, at $100 training cost.
March 28, 2023 – Open Source GPT-3 by Cerebras outperforms existing GPT-3 clones.
March 28, 2023 – LLaMA-Adapter introduces instruction tuning and multimodality with just 1.2M learnable parameters.
April 3, 2023 – Berkeley launches Koala, users prefer it or have no preference 50% of the time compared to ChatGPT.
April 15, 2023 – Open Assistant launches a model and dataset for Alignment via RLHF, achieving near-ChatGPT human preference levels.
Open-source AI development is a better approach than closed-source AI development, particularly when considering the potential of Artificial General Intelligence (AGI). The open-source approach fosters collaboration, accessibility, and transparency, while promoting rapid development, preventing monopolies, and ensuring many benefits.
Here are a few reasons why I think open-source AI development should win in the long-term:
Collaboration is key in open-source AI, as researchers and developers from diverse backgrounds work together to innovate, increasing the likelihood of AGI breakthroughs.
Open-source AI is accessible to anyone, regardless of location or financial resources, which encourages a broader range of perspectives and expertise.
Transparency in open-source AI allows researchers to address biases and ethical concerns, fostering responsible AI development.
By building upon existing work, developers can rapidly advance AI technologies, bringing us closer to AGI.
Open-source AI also reduces the risk of single organizations dominating the AI landscape, ensuring that advancements serve the greater good.
Additionally, the benefits of AI are more evenly distributed across society through open-source AI, preventing the concentration of power and wealth.
Lastly, open-source AI development improves the security of AI systems, as potential flaws can be discovered and fixed by a larger community of researchers and developers.
Let’s end this article with another great quote from the article:
Quote: “Google and OpenAI have both gravitated defensively toward release patterns that allow them to retain tight control over how their models are used. But this control is a fiction. Anyone seeking to use LLMs for unsanctioned purposes can simply take their pick of the freely available models.”
Feel free to share this article with your friend and download our OpenAI Python API Cheat Sheet and the following “Glossary” of modern AI terms:
OpenAI Glossary Cheat Sheet (100% Free PDF Download)
Finally, check out our free cheat sheet on OpenAI terminology, many Finxters have told me they love it!
One of the supreme deities created this vast world called Engardin, upon which natural wonders lie everywhere: gigantic volcanoes, steep canyons, deep seas and a tower that soars into the clouds...
Encounter fantastic creatures during your journey: giant beasts wandering in fire, and spirits lurking in the depth of complicated labyrinths... Learn about your new friends, get to know their pasts and the agendas they hold.
Engardin is alive with unknown secrets. Venture forth and feel free to explore wherever you like as a brave adventurer. Find out the stories that link each area, discover a concealed history and the truth of the world.
The Rend Bleed Barbarian is a build using Rend and Rupture to stack bleeds in your enemies and finished them with a great Rupture. Most of our points are allocated to bleed abilities or on buffs which help us generate Fury, and increase our damage or our survivability. Until you get Rupture, you can just tell your dungeons while applying bleeds with Rend and Flay and allow the enemies to die (cool guys don't take a look at explosions or undead dying from bleed damage). This build is created so you can have fun using the Rupture skill. However, whenever we hit level 25, we want to include an Ultimate skill in the Skill bar but we're lacking space. You will either drop Leap, War Cry, or Rallying Cry depending on your needs.
Basic Skill - Flay: Flay the enemy, dealing damage and inflicting a bleed. Enhanced Flay allows Flay to make the enemy vulnerable and Battle Flay boosts the damage our target takes from Bleeds for some seconds, a debuff we wish to be active all the time.
Core Skill - Rend: Cleave enemies before you, dealing damage and inflicting an awful bleed over 5 seconds. We add Enhanced Rend to create Vulnerably to keep going longer and then you can choose which passive you would like depending on your needs. If you don't have any Fury problem, take Violent Rend. If you have Fury problems, probably because you dropped Rallying Cry to have an Ultimate Skill, take Furious Rend.
Defensive Skill - Rallying Cry: This Shout increases your Movement Speed and Resource Generation for any short time for both you and your allies. Enhanced Rallying Cry grants Unstoppable while active, after which you have two choices. Spamming Rend is the core of the build, so taking Tactical Rallying Cry increases your resource regeneration a great deal. But you might feel a little squishy, and when you start to take a great deal of damage, consider Strategic Rallying Cry which will bring in a lot of healing.
If you want to skip farming or leveling, you can take a quick look at our cheap diablo 4 gold and diablo 4 gold for sale!
Brawling Skill - War Cry: War Cry increases damage accomplished for both you and your allies. Enhanced War Cry grants Berserking for 3 seconds. Power War Cry increases your damage bonus if you will find 4 or even more enemies nearby. If you're experiencing survivability or playing a support role, you can substitute Mighty War Cry instead, which grants 28% of the Base Life as Fortify.
Brawling Skill - Leap: Leap is an incredibly important movement skill, allowing both horizontal and vertical changes. Leap forward and slam down, dealing damage and knocking back surrounding enemies on impact. Sadly, we do not have enough points to upgrade it but when you wish to jump around more often you can drop some upgrades in Rupture and Rend to possess more fun taking Enhanced Leap and Power Leap.
Weapon Mastery Skill - Rupture: This skill is among the new skills put into the Barbarian in Diablo 4. I desired to try it out, along with a Bleed build is perfect. Rupture skewers enemies before you, dealing damage. Then, you rip your weapon out, damaging enemies for their total Bleeding amount and Removing all Bleeding Damage from their store. The idea would be to build a great deal of Bleeds with Rend and Flay after which Casting Rupture to deal a great deal of Burst Damage. You can take Enhanced Rupture to add a little of AoE harm to Rupture after which choose between Warrior's Ruptures for additional damage or Fighter's Rupture for additional healing.
Ultimate Skill - None ?: This was the toughest part while considering this build. We have only 6 skill slots. So if we wish to take an Ultimate Skill, we must sacrifice among the other skills. Flay might get sacrificed, but we'd lose the 10% increased bleed damage. Fury generation would only originate from Tactical Rallying Cry and Furious Rend. If we wish to keep Flay, Leap and War Cry can't go, they're just too strong. So we'd sacrifice Rallying Cry, quite a strong spell that allows us to consider more damage nodes and fewer fury generation. Then we now have to take a look at the Ultimate skills with no upgrades: Wrath from the Berserker is really a nice buff but we now have nothing to enhance Berserking, therefore it loses a great deal of value, Call from the Ancient is nice but includes a poor uptime and lastly, Iron Maelstrom may be the only Ultimate skill applying bleeds but we're only thinking about 1 from the 3 effects. So at this time, I'm not convinced by raw Ultimate skills for any Bleed build but those thoughts might change after testing them.
TL;DR: taking an Ultimate skill gives us more burst but less AoE DPS, along with a Bleed Build only appears to synergize with Iron Maelstrom which feels a little weak for the time being without empowering it using its upgrades. This part of the build needs more testing to know what we can drop or if we need an Ultimate skill.
Decided to release all the dlc for T5 under a new thread. the old other one has broken redirect links and are uploaded through mega which slows down download speed.
Today I am going to be releasing Black Ops's DLC map pack Feel free to download it! If the download links don't work anymore, comment below or PM me and I'll fix it ASAP.
I put my time and effort into making the topic and making it easy to use. Enjoy the DLC's Packs
The Mega.nz download link has all the DLC map packs shown below, that's why the file size is 2.47GB
Note*I am not going to list what is in the DLC pack since you should already know what's in the DLC pack. Sorry it takes too much time to make the threat by listing what's in the DLC packs, one by one....
The install it pretty easy to do, open up the folders for one of the DLC packs and then look at the folders name. Then look in your Black Ops Steam folder and see where it goes.
Downloads Links
Remember before downloading please comment below saying something like "thank you" etc.. It's not hard to say "thanks"
Redacted
Hello guys, today I present you the Redacted T6 Nightly Offline Client. In my opnion the best Bo2 Mod Developer Client. You can simple use Mods by useing GSC Studio.
Features
Play Call of Duty Black Ops 2: Multiplayer - Zombie Offline without a connection.
Develop GSC Mods with GSC Studio, without any ban risk.
Update: 5/16/26
The redacted team is no longer updating this. The download here is the newest available but there is another service that is better now.
Plutonium: https://sickgaming.net/thread-101101.html
Follow the link above to get the download for it. Play online, with friends, solo. Call of duty zombies free for everyone
I am hear to present to you Plutonium's new client for T6 (Black Ops 2).
All Games AnticheatController SupportAim Assist - Although this is WIP for WAW.cg_fovScale unlockedclanname dvar, allowing clantags to functioncom_maxfps unlockedDiscord Rich PresenceTheater/Demo System for all gamesUPNP for custom games, which allows fri
I am sure most of the Call of Duty fans that play on PC are fond of Redacted. If not, Redacted is a older client for Black Ops 2. However, the Redacted team had to shut down the client for several reasons, which left the Redacted client unstable and dead. Countless people always have issues with the client.
But today, I can proudly tell you that a new Black Ops 2 client has surpassed the horizon and has shed some light in the COD community; Plutonium T6.
Plutonium T6 will feature dedicated servers for your choice as well as the traditional matchmaking servers on multiplayer and zombies. Eventually (after initial release), the client will support custom maps, custom weapons, custom camos, and more. All these will be at your convenience Soon™.
For the modders, if you modded on Redacted or create mods, you will be able to do so but you will have to use the tools given by us. Thus is the only way you won't be banned for modding. As I learn more info about modding on Pluto T6, I will share it.
Hello guys,
since after our source release of the Jiggy Mod Menu many people are asking how to install the mod menu. Here I created a thread about how to use it on the PC. Console version can be found in respective forum.
Quote: “But the uncomfortable truth is, we aren’t positioned to win this arms race and neither is OpenAI. While we’ve been squabbling, a third faction has been quietly eating our lunch.”
and download our 
![[Image: dlc1_screenshots_berlinwall_large_3.jpg]](https://www.callofduty.com/content/dam/activision/callofduty/blackops/master/dlc/dlc1_screenshots_berlinwall_large_3.jpg)
![[Image: Treyarch.jpg]](http://arabhardware.net/wp-content/uploads/2014/12/Treyarch.jpg)
![[Image: c4isa8my.png]](http://fs5.directupload.net/images/160125/c4isa8my.png)
![[Image: 7pCDK4a.png]](https://i.imgur.com/7pCDK4a.png)
![[Image: QeqoUgG.png]](https://i.imgur.com/QeqoUgG.png)
![[Image: 228ad8b678f7412ba3abe41e1ad97c17.jpeg]](https://image.prntscr.com/image/228ad8b678f7412ba3abe41e1ad97c17.jpeg)
