GSV's AI News & Updates (06/02/22)
Nvidia Strikes Again, AI-enhanced NPCs, OpenAI's Plans, "Risk of Extinction", UAE's Falcon 40B, Google's Models can Read Charts, ChatGPT's Media Coverage
You are receiving this weekly update on the intersection of AI and education, as part of our GSV community – we hope this will be a helpful resource as we navigate this evolving and exciting intersection. Please feel free to send over any relevant resources you may come across (claire@gsv.com) – we’d love to learn and hear from you!
General 🚀
OpenAI's plans according to Sam Altman:
OpenAI is heavily GPU limited at present, which is delaying a lot of their short-term plans around longer context windows and better support for finetuning
Cheaper and faster GPT-4 - their aim is to drive “the cost of intelligence” down as far as possible
Multimodality was demoed as part of GPT-4 release but can’t be extended until after more GPUs come online
Plugins “don’t have PMF” and are probably not coming to the API anytime soon - a lot of people thought they wanted their apps to be inside ChatGPT but what they really wanted was ChatGPT in their apps
OpenAI will avoid competing with their customers - the vision for ChatGPT is to be a super smart assistant for work but there will be a lot of other GPT use-cases that OpenAI won’t touch
Scaling laws for model performance continue to hold
Nvidia announced Avatar Cloud Engine (ACE) for Games: the new solution utilizes generative AI to enhance non-player characters (NPCs) in video games. It is designed to assist game developers in creating more realistic and dynamic virtual characters that can interact with players. Watching a single video of a single conversation, it’s hard to see how this is any better than picking from a NPC dialogue tree — but the impressive part is that the generative AI is reacting to natural speech live.
Welcome to the trillion-dollar club, Nvidia: Nvidia’s graphics processing units, or GPUs, are critical to generative AI platforms like OpenAI’s ChatGPT and Google’s Bard.
The world’s biggest ad agency is going all in on AI with Nvidia’s help
All the Nvidia news announced by CEO Jensen Huang at Computex
Top AI researchers and CEOs warn against ‘risk of extinction’ in 22-word statement: signatories include Google DeepMind CEO Demis Hassabis and OpenAI CEO Sam Altman.
“We are an information revolution species”: The many transformations of the information revolution centuries show us that democratizing expression always aids the democratization of power, aids community organization, civil rights movements, justice, human dignity and flourishing.
AI21 Labs concludes largest Turing Test experiment to date: since its launch in mid-April, more than 10M conversations have been conducted in “Human or Not?”, by more than 1.5M participants from around the world.
68% of people guessed correctly when asked to determine whether they talked to a fellow human or an AI bot.
People found it easier to identify a fellow human. When talking to humans, participants guessed right in 73% of the cases. When talking to bots, participants guessed right in just 60% of the cases.
OpenAI’s ChatGPT Plugins feature is the new Internet gateway: why OpenAI’s ChatGPT Plugins feature combined with the power of GPT agents is the new Internet gateway and the real Web 3.0?
VC Giants Accel, Sequoia Scour Portfolio Startups for AI Risk
The AI Boom Runs on Chips, but It Can’t Get Enough: ‘It’s like toilet paper during the pandemic.’ Startups, investors scrounge for computational firepower.
How the media is covering ChatGPT: a look at how news organizations have been covering generative AI over the past six months.
New AI launches:
Instacart launches new in-app AI search tool powered by ChatGPT
Snapchat launches ‘My AI Snaps’ for paid subscribers: Snap also rolled out other AI-infused updates across the app, including the ability to add My AI chatbot into group chats with friends and the ability to use AI for place recommendations and Lens suggestions.
CrowdStrike introduces Charlotte AI, a generative AI Security Analyst
Education and the Future of Work 📚
How AI will Change Higher Education: 10% Less Stagnation: As an economist, I scoff at the idea that AI will permanently disemploy the population. Human wants are unlimited, and human skills are flexible. Agriculture was humanity’s dominant industry for millennia; yet when technology virtually wiped out agricultural jobs, we still found plenty of new work to do instead. I do not, however, scoff at the idea that AI could drastically reduce employment in CS over the next two decades. Humans will specialize in whatever AI does worst.
Startups and Tools 🛠️
gptfile: a way to organize files with natural language using GPT-4.
Graphy: the easiest way to create stunning and interactive charts.
Tactiq: AI Meeting Kits to automate actions from your discussions and create personalized AI meeting notes for each meeting.
Consensus: a search engine that uses AI to extract and distill findings directly from scientific research.
AutoCode: AI agent that transforms your half-baked ideas into ready-to-use codebases. It is a sizable step forward in generating fully working code from text prompts, no human required.
CoachVox: clone yourself with AI trained on your content and style, to coach, mentor and answer questions just like you would.
Tech 💻
UAE's Falcon 40B is now Royalty Free: Technology Innovation Institute’s (TII) Falcon 40B, the UAE’s leading large-scale open-source AI model, is now free of royalties for commercial and research use. Ranked #1 globally on Hugging Face’s leaderboard for large language models (LLMs), Falcon 40B outperforms competitors like Meta’s LLaMA and Stability AI’s StableLM.
Google developing foundation models that can read and reason charts: MatCha, which stands for math and charts, is a pixels-to-text foundation model (a pre-trained model with built-in inductive biases that can be fine-tuned for multiple applications) trained on two complementary tasks: (a) chart de-rendering and (b) math reasoning.
OpenAI on improving mathematical reasoning with process supervision: they trained a model to achieve a new state-of-the-art in mathematical problem solving by rewarding each correct step of reasoning (“process supervision”) instead of simply rewarding the correct final answer (“outcome supervision”).
Voyager - the first LLM-powered embodied lifelong learning agent in Minecraft: that continuously explores the world, acquires diverse skills, and makes novel discoveries without human intervention.
three key components: 1) an automatic curriculum that maximizes exploration, 2) an ever-growing skill library of executable code for storing and retrieving complex behaviors, and 3) a new iterative prompting mechanism that incorporates environment feedback, execution errors, and self-verification for program improvement.
How LangChain calculates OpenAI's pricing?: and insights on why LangChain exists and how it is helpful for developers.
Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee
Macaw-LLM: multi-modal language modeling by seamlessly combining image, video, audio, and text data, built upon the foundations of CLIP, Whisper, and LLaMA.
Regulation and Policy ⚖️
Biden Administration Torn on AI policy: some officials fear tough regulation will give China an edge. US and EU are discussing AI regulation this week in Sweden.
Fun/Other 🎉
Dreamore: an AI dream interpretation tool. The app that interprets and paints your subconscious thoughts. You can choose from different dream interpreters, such as Freud and Lord Shiva.
Expanding famous album covers using Adobe’s AI Generative Fill tool:
