Research | OpenAI
Josh Achiam, Researcher at OpenAI Focus areas We build our generative models using a technology called deep learning, which leverages large amounts of data to train an AI system to perform a task.
In this paper, we explore a semi-supervised approach for language understanding tasks using a combination of unsupervised pre-training and supervised fine-tuning. Our goal is to learn a universal representation that transfers with little adaptation to a …
Research - OpenAI
Explore the research we're conducting to stay at the forefront of AI development and deployment.
Improving language understanding with unsupervised learning
2018年6月11日 · We’ve obtained state-of-the-art results on a suite of diverse language tasks with a scalable, task-agnostic system, which we’re also releasing. Our approach is a combination of two existing ideas: transformers and unsupervised pre-training. These results provide a convincing example that pairing supervised learning methods with unsupervised pre-training works very well; this is an idea ...
GPT-4 - OpenAI
Research GPT-4 is the latest milestone in OpenAI’s effort in scaling up deep learning. View GPT-4 research Infrastructure GPT-4 was trained on Microsoft Azure AI supercomputers. Azure’s AI-optimized infrastructure also allows us to deliver GPT-4 to users around the world.
Weak-to-strong generalization - OpenAI
2023年12月14日 · Today, we are releasing the team’s first paper, which introduces a new research direction for empirically aligning superhuman models. Current alignment methods, such as reinforcement learning from human feedback (RLHF), rely on human supervision.
Video generation models as world simulators | OpenAI
2024年2月15日 · We explore large-scale training of generative models on video data. Specifically, we train text-conditional diffusion models jointly on videos and images of variable durations, resolutions and aspect ratios. We leverage a transformer architecture that operates on spacetime patches of video and image latent codes. Our largest model, Sora, is capable of generating a minute of high fidelity video ...
In this white paper, we suggest a definition of agentic AI systems and the parties in the agentic AI system life-cycle, and highlight the importance of agreeing on a set of baseline responsibilities and safety best practices for each of these parties.
Figure1: Exampleofatext-screenshotjailbreakprompt. GPT-4V-Earlydemonstratesthemodels’ earlyperformanceforsuchpromptsandGPT-4VLaunchdemonstratestheperformanceofthemodel
the following URL: https://github.com/openai/ whisper. 2. Approach 2.1. Data Processing Following the trend of recent work leveraging web-scale text from the internet for training machine learning systems, we take a minimalist approach to data pre-processing. In contrast to a lot of work on speech recognition, we train