OpenAI founding member Andrej Karpathy shares tips on making the most of artificial intelligence
Haebom
•
A talk from Microsoft's Build event. Andrej Karpathy explains how to write effective prompts for AI.
•
Korean subtitles are available, so if you'd like to see it for yourself, I recommend giving it a watch.
•
Andrej Karpathy is the talented person who founded OpenAI and headed Tesla's AI division (Twitter)
When I jot things down...
•
It's useful for AI models to break documents into smaller pieces, embed them, store them in a repository, and then use queries to retrieve relevant chunks to insert into prompts for performing tasks.
•
Using prompt engineering techniques, you can constrain the output of LLMs to fit a specific template.
•
Fine-tuning improves performance by altering the model's weights, but it's technically complex and costly.
•
There are limitations and challenges to be mindful of when using LLMs, but combining them with human oversight can deliver safe and trustworthy results.
•
The GPT-4 model currently offers the best performance, and it's recommended to use detailed and clear prompts.
•
Adding relevant context and information to your prompt helps the LLM understand better.
•
Including examples helps the LLM understand your intent more clearly.
•
Consider using tools and plugins to help LLM handle more complex tasks.
•
Once you've gotten the most out of prompt engineering, you can also consider fine-tuning the model for further performance optimization.
•
LLMs can optimize costs by using low-precision inference and training on fixed parts of the model.
📚 Welcome to Haebom's archives. --- I post articles related to IT 💻, economy 💰, and humanities 🎭. If you are curious about my thoughts, perspectives or interests, please subscribe. haebom@kakao.com