GameGen-X: Interactive Open-world Game Video Generation

Overview of GameGen-X Functionality

Part I for the basic functionality showcase, and Part II for the key features of GameGen-X (0:47).

High-quality Game Generation

Character Generation    

Environment Generation    

Action Generation    

Event Generation    

Open-domain Generation    

Multi-modality Interactive Control

Structural Instruction Prompts    

Operation Signals    

Video Prompts    

Qualitative Comparision

Generation Comparision    

Control Comparision    

OGameData Showcase


OGameData Summary: OGameData is a comprehensive multi-genre open-world video game dataset, which contains generation and control subsets. Sourcing over 32,000 videos from local engines and the internet, each video ranges from several minutes to several hours in length. The dataset features more than 150 next-generation games across various genres, including open-world RPGs, FPS, racing games, action-puzzle games, and more. It also covers different perspectives (first-person, third-person) and styles (realistic, Eastern traditional, cyberpunk, post-apocalyptic, Western fantasy, etc.). After a rigorous selection process that spanned six months and involved multiple human experts and advanced model algorithms, we have curated over 4,000 hours of high-quality video clips, ranging from 720p to 4k resolution. These segments were meticulously annotated by GPT-4O, providing a rich source of labeled data for training and validation purposes. The OGameData is expected to become an invaluable resource for researchers and developers, enabling the exploration of various applications such as video game generative AI development, interactive control, and immersive virtual environments. Its imminent open-source release will offer the scientific community unprecedented access to a broad spectrum of video game data, fostering innovation and collaboration across multiple disciplines.


OGameData for Generation Training    

OGameData for Instruction Tuning    

Acknowledgements: Our project page is borrowed from DreamBooth.