New AI Agent Creates 3D Objects from Sketches with CAD

MIT introduces an AI that learns to operate CAD software, simplifying 3D design for engineers.

MIT has developed a new AI agent called VideoCAD that can use computer-aided design (CAD) software to create 3D objects from 2D sketches. This innovation aims to boost designer productivity and help train new engineers by automating complex CAD operations.

Katie Rowan

By Katie Rowan

December 8, 2025

3 min read

New AI Agent Creates 3D Objects from Sketches with CAD

Key Facts

  • MIT engineers developed a new AI agent called VideoCAD.
  • The AI learns to use CAD software to create 3D objects from 2D sketches.
  • It operates by performing keyboard and mouse commands and selecting software options.
  • The tool aims to boost designers' productivity.
  • It could also assist in training engineers learning CAD.

Why You Care

Ever struggled to translate a simple sketch into a complex 3D model? Imagine if an AI could handle all the tedious software commands for you. What if your brilliant design ideas could instantly become tangible 3D representations? This new creation from MIT promises to make that a reality, directly impacting how you approach design and engineering tasks.

What Actually Happened

MIT engineers have unveiled a novel AI model designed to operate computer-aided design (CAD) software. This AI agent, dubbed VideoCAD, can transform 2D sketches into detailed 3D models, according to the announcement. It achieves this by mimicking human interaction, executing keyboard and mouse commands within the CAD environment. The AI selects buttons and navigates file options, effectively learning to use the software just like a person would. This means a complex process, traditionally requiring extensive training, could become much simpler. The virtual VideoCAD tool could significantly boost designers’ productivity, as mentioned in the release.

Why This Matters to You

Computer-Aided Design (CAD) is crucial for creating most physical products today. However, CAD software is famously difficult to master, featuring thousands of commands. This new AI agent could change that experience for you. Imagine you’re an industrial designer with a great concept for a new product. Instead of spending hours meticulously inputting commands, you could provide a sketch, and the AI would generate the 3D model. This frees you up to focus on creativity and refinement, not software mechanics. The research shows this could also help train engineers learning CAD.

Key Benefits of the New AI Agent

  • Increased Productivity: Designers can create 3D models much faster.
  • Simplified Learning: New engineers can grasp CAD concepts more easily.
  • Reduced Complexity: The AI handles intricate software commands.
  • Enhanced Creativity: Focus shifts from operation to design creation.

For example, consider an architect sketching a new building facade. Instead of manually translating every line and curve into a 3D CAD model, the architect could feed the sketch to the AI. The AI would then construct the 3D representation, allowing the architect to quickly visualize and iterate on the design. How much more creative could you be if your tools understood your intent directly from a sketch?

The Surprising Finding

The most intriguing aspect of this creation is the AI’s ability to learn CAD software “much like a human would.” This goes beyond simple automation. The team revealed that the model can carry out keyboard and mouse commands and select buttons and file options within the software. This challenges the assumption that complex, multi-step software operation is exclusively a human domain. It suggests a deeper level of machine understanding and interaction with user interfaces than previously common. This capability is particularly surprising given the notorious complexity of CAD systems.

What Happens Next

This AI agent, VideoCAD, is expected to see further creation and integration into design workflows over the next 12 to 18 months. We might see initial pilot programs in specialized design firms by late 2025 or early 2026. For example, a small product design studio could use this AI to rapidly prototype new concepts, significantly cutting down creation time. The company reports that the tool could help train engineers learning computer-aided design. This means future engineering curricula might incorporate AI-assisted CAD learning. Your design process could become much more intuitive and efficient. This creation could lead to faster product creation cycles across industries, from automotive to consumer electronics. It will be interesting to see how quickly this system becomes widely adopted.

Ready to start creating?

Create Voiceover

Transcribe Speech

Create Dialogues

Create Visuals

Clone a Voice