Art Technology

Art Beyond the Screen

Johann Baptist Enderle, “Design for a Wall Panel or Ceiling with The Virgin and Saints Interceding before Christ for the Souls of the Lost” (1771 or before). The Metropolitan Museum of Art, Public Domain (CC0).

Spatial computing and the new architecture of experience

IE by intendle Editors Aug 7, 2026 · 17 min read

Virtual museums, mixed-reality exhibitions and shared immersive worlds are changing where art can exist, who can enter and what institutions must preserve. The decisive question is no longer whether immersion is impressive, but whether it creates knowledge, presence and access that another medium could not.

The most persuasive virtual museum of recent years does not begin by pretending that nothing has been lost. UNESCO's Virtual Museum of Stolen Cultural Objects was created around absence. Its digital galleries present cultural objects reported stolen or missing by member states, alongside historical context and testimony connected to the communities from which those objects disappeared.

Launched globally in September 2025, the project had received more than 205,000 visitors and 1.6 million page views by May 2026. It is immersive, but its purpose is not escape. The spatial interface makes illicit trafficking and cultural loss perceptible by placing the missing object within an interpretive architecture rather than reducing it to an entry in a police database.

This is a useful starting point for understanding spatial computing in art. Virtual reality, augmented reality and mixed reality are often discussed as technologies for adding spectacle. Their more consequential potential lies elsewhere. They can change scale, restore context, visualize the inaccessible, connect remote audiences, reveal hidden processes and allow an artwork or collection to unfold across physical and digital space.

They can also exclude. Headsets are expensive and uncomfortable for some users. Interfaces can disregard disability. Platforms can lock institutions into proprietary ecosystems. A virtual reconstruction can create a false sense of certainty about a damaged site or contested history. An immersive work can become unviewable when an operating system, game engine or device disappears.

Spatial computing therefore requires the discipline of architecture. It organizes movement, attention, encounter, access and memory. It is not merely an image wrapped around the viewer.

The central answer

Spatial computing becomes artistically and institutionally valuable when it offers a form of understanding that cannot be achieved through a flat screen or physical display alone. It can let visitors inhabit scale, relation, time and inaccessible environments. Yet a successful immersive work must be designed for bodies, social interaction, accessibility, historical uncertainty and long-term preservation. The headset is not the artwork. The artwork is the choreography of space, perception, information and human presence.

Immersion is a spatial argument

A conventional screen establishes a clear boundary. The image appears in front of the viewer. Spatial media complicates that relation. Digital elements can surround the body, attach themselves to a building, respond to gaze or movement, or coexist with physical objects.

This changes the grammar of interpretation.

An exhibition designer no longer asks only where an image should hang. They ask where an event begins, how a visitor understands direction, which actions are possible, whether another person can be perceived and what happens when attention turns away.

Every immersive work makes a spatial argument, even when the space looks neutral. It defines:

the distance between viewer and subject;
the scale at which an object is encountered;
whether the visitor observes or acts;
which routes are available;
whether other visitors are present as people or avatars;
which information appears only after movement;
what the system records about the body.

Poor spatial design overwhelms the viewer with novelty. Strong spatial design makes the technology recede into a coherent experience.

The distinction resembles architecture because both fields organize possibility. A door suggests an action. A threshold changes expectation. A low ceiling compresses the body. A digital boundary can do the same, but it can also change dynamically, disappear or respond to the visitor. That flexibility is powerful precisely because it can become manipulative.

A museum made of missing objects

The UNESCO virtual museum was designed with INTERPOL, technical partners and local communities. Its stated purpose is to raise awareness of illicit trafficking and contribute to the recovery of stolen cultural property. The galleries include educational materials, stories and testimonies rather than displaying 3D objects as isolated technological achievements.

The architecture of the project carries an ethical burden. Digital reconstruction cannot return the physical object. It should not imply that loss has been repaired because a virtual version is accessible. The digital museum can preserve knowledge, widen awareness and support identification, but the missing work remains missing.

This difference should be visible in the experience.

A reconstruction is most credible when it marks uncertainty. The system can distinguish documented dimensions from inferred surfaces, archival color from speculative restoration, and community testimony from curatorial interpretation. It can allow users to understand not only what an object looked like, but where it belonged and what its removal changed.

Spatial media is especially powerful here because context can be built around absence. A conventional catalog places a stolen object within a page. An immersive museum can organize relations among architecture, ritual, landscape, voice and history. It can show why an object's meaning exceeded its material form.

Yet the digital representation must remain accountable to the originating community. A technically sophisticated reconstruction can repeat an extractive pattern if an external institution decides how a culture should be represented without meaningful authority from the people concerned.

The physical museum does not disappear

Predictions that virtual museums will replace physical institutions misunderstand what a museum does. Museums are not only containers of information. They are places where bodies share time, encounter material evidence and negotiate public memory.

Digital space can extend those functions, but it cannot reproduce all of them.

The texture, weight, age and scale of an object influence interpretation. So do the presence of other visitors, the authority of the building, the route through a gallery and the knowledge that the object has survived. A perfectly detailed model does not carry the same material history.

The more productive model is hybrid.

UCL's World of Wasps exhibition brought specimens, nests, scientific research, commissioned sculpture, projection and two virtual-reality experiences into the Grant Museum of Zoology. Visitors could enter a scientifically informed virtual nest and take a wasp's-eye journey through a rewilded museum. The VR did not replace the collection. It revealed behaviors and scales that the specimens could not show alone.

UCL later reported approximately 20,000 visitors during the exhibition run, a 6.3 percent increase over a comparable period, and evidence that the VR attracted first-time visitors. The meaningful result was not simply that people tried a headset. The technology helped change how visitors understood an animal commonly reduced to fear and nuisance.

This is a useful measure for immersive culture: not how many people were impressed, but what relation became thinkable.

When augmentation serves the object

Augmented reality places digital information into the physical field. It can animate a historical image, reconstruct a missing layer, translate text or reveal a detail too small to inspect.

A 2025 UCL pilot called ARt-Z: Unlock the Unseen used augmented reality with ten digitized Chinese export watercolors from the Victoria and Albert Museum's collection. The project invited visitors to uncover details and interactive narratives beyond the frame.

Such augmentation can deepen engagement when it remains accountable to the original object. It becomes weaker when animation is applied simply because a static work is assumed to be insufficient for a younger audience.

The guiding question should be: what can the digital layer reveal that is materially, historically or perceptually hidden?

Possible answers include:

the reverse of a fragile work that cannot be handled;
changes discovered through conservation imaging;
a lost architectural setting;
trade routes connecting an object's materials;
several translations or oral histories;
alternative interpretations from different communities;
the sequence of a performance or process.

The digital layer should not compete for attention with the object. It should clarify why the object can sustain more than one way of seeing.

Interaction is not the same as agency

Immersive projects often describe themselves as interactive because a visitor can point, select or move. These actions may amount to little more than navigating a menu.

Meaningful agency requires consequence.

If a visitor's choice changes nothing beyond the next animation, the work remains largely linear. That may be appropriate. Not every exhibition needs open-ended participation. The problem arises when institutions advertise agency while offering only decorative input.

A serious interactive work should define:

which choices are possible;
what those choices change;
whether consequences persist;
whether the visitor can understand the system's response;
how the work treats unexpected behavior;
whether participation affects other people.

Social presence is particularly important. A museum visit is often collective even when visitors do not speak. People observe one another, negotiate space and share attention. A headset can isolate the user from that public condition.

Designers can respond through shared displays, mirrored views, facilitated conversation, multi-user environments or transitions that reconnect the virtual experience to the physical gallery. The goal is not to eliminate solitary immersion. It is to decide whether isolation serves the work.

Access can expand and contract at once

Virtual exhibitions can reach audiences unable to travel. They can provide access to closed sites, fragile environments and dispersed collections. A browser-based experience may be available across continents at any hour.

But access is never simply global.

A high-end headset may cost more than many institutions or households can afford. Reliable broadband, powerful hardware and platform accounts create further barriers. Interfaces can be unusable for people with limited vision, hearing, mobility, balance or tolerance for motion. Some users experience nausea, fatigue or disorientation. Others cannot wear a headset for medical, religious or personal reasons.

An accessible immersive project therefore needs more than a general statement that it is available online.

It should consider:

seated and standing modes;
adjustable movement and speed;
alternatives to smooth locomotion;
captions, audio description and sign-language interpretation;
high-contrast and scalable interfaces;
controller-free or simplified input;
browser, video or physical alternatives;
clear warnings about sensory intensity;
staff support and sanitation;
access without compulsory personal accounts.

A virtual museum that can be visited from anywhere but only through one expensive device is not universally accessible. It has exchanged one threshold for another.

The platform beneath the experience

Immersive artworks are built within technical ecosystems. A project may depend on a headset manufacturer, operating system, game engine, application store, tracking method and cloud service. These dependencies influence who can see the work and how long it can survive.

OpenXR was developed as a cross-platform standard for access to virtual, augmented and mixed-reality devices. Version 1.1 consolidated widely used extensions into the core specification with the aim of reducing fragmentation. Interoperability can help creators avoid rewriting an entire application for each device, but a standard does not erase platform differences.

Hardware capabilities vary. Controllers, hand tracking, eye tracking, spatial mapping and display performance are implemented differently. Commercial platforms can change distribution rules, privacy terms or support periods. A work accepted by a museum today may depend on an application store that will not exist in ten years.

Artists should therefore distinguish the artistic system from its current delivery platform.

They should preserve source assets, code, engine versions, build settings and spatial logic in a form that can be migrated. Where possible, they should avoid unnecessary dependence on proprietary cloud services. Institutions should understand which components are replaceable and whether a browser-based, projected or recorded version can preserve part of the experience.

Conservation of an event that has no stable room

Spatial works are difficult to preserve because their identity may be distributed among software, architecture, hardware and embodied experience.

A conservation dossier should record:

source code and project files;
engine, plug-in and operating-system versions;
3D models, textures, audio and video assets;
coordinate systems and spatial dimensions;
interaction logic and state changes;
network and data dependencies;
approved devices and possible substitutions;
accessibility settings;
visitor-flow and facilitation instructions;
privacy and retention policies;
video from inside and outside the experience;
the artist's hierarchy of essential properties.

Preserving a screen recording is not enough. It captures one path through a work and removes the body from the experience. Preserving the original headset is also insufficient if batteries fail or software authentication stops.

Conservation may require migration, emulation, reinterpretation or reconstruction. Each method changes something. The responsible institution documents those changes rather than pretending that technical reproduction is neutral.

The revised ICOM Code of Ethics, adopted in June 2026, explicitly acknowledges digital technologies among the contemporary challenges facing museums. This places immersive preservation within a larger ethical responsibility. Institutions must consider public trust, data, accessibility, colonial legacies and climate impact alongside technical survival.

The data produced by a moving body

Spatial systems can collect unusually intimate information. Head and hand movement, gaze direction, voice, room geometry and behavioral patterns may be processed to make an experience function.

Art institutions cannot treat this data as harmless simply because the purpose is cultural.

Visitors should know:

what is measured;
whether it remains on the device;
whether it is transmitted to a platform;
how long it is retained;
whether it is connected to an account;
whether it is used for analytics or system training;
whether biometric inference is involved.

The European AI Act's transparency obligations reinforce the importance of informing people when they interact with certain AI systems or encounter emotion recognition and biometric categorization. Even where a particular artwork falls outside a legal category, ethical practice should not wait for enforcement.

An immersive installation can create trust precisely because the visitor surrenders ordinary spatial awareness. That trust should not be converted silently into data extraction.

Beyond spectacle

The first generation of public fascination with virtual reality often centered on the sensation of being transported. Transport is no longer enough.

The strongest spatial works make the viewer aware of a relation that could not be perceived otherwise. They can enter the architecture of a wasp nest, encounter a dispersed cultural history, walk through a possible future or understand how a physical collection connects to an invisible ecosystem.

The technology earns its place when it changes knowledge.

This does not require realism. A highly stylized world can be more truthful than a photorealistic reconstruction if it makes uncertainty and interpretation visible. Nor does it require constant interaction. Stillness can be immersive when space, sound and duration are composed with precision.

The future of spatial art will not be determined by headset resolution alone. It will depend on whether artists and institutions can create experiences that remain ethically, socially and technically inhabitable.

Art beyond the screen needs more than a new display. It needs an architecture of responsibility.

Six questions readers may ask

1. Will virtual museums replace physical museums?

No. Virtual museums can widen access, reconstruct inaccessible contexts and connect distributed collections, but they do not reproduce the material presence, public gathering and historical authority of physical institutions. The stronger model is hybrid: digital space reveals scale, behavior or context that the gallery cannot show, while physical objects and social encounters provide forms of evidence that simulation cannot replace. A virtual museum should define its own purpose rather than presenting itself as a cheaper copy of a building.

2. What makes an immersive artwork more than a technological demonstration?

The technology must serve a clear artistic or interpretive necessity. The work should use spatial relation, embodiment, interaction or scale to create knowledge or feeling that another medium could not provide as effectively. A technically impressive environment remains a demonstration when its main content is the novelty of the device. Strong immersive art has a coherent position, purposeful constraints and a reason for placing the viewer inside its system.

3. Are VR and AR exhibitions genuinely accessible?

They can expand access for remote visitors and people unable to enter a particular site, but they can also create new barriers. Cost, broadband, platform accounts, motion sickness, sensory overload, limited mobility and inaccessible controllers all matter. Institutions should provide multiple modes of access, including seated options, captions, audio description, adjustable movement and non-headset alternatives. Accessibility must be tested with users rather than assumed from the fact that an experience is digital.

4. How can a museum preserve a work built for a headset that becomes obsolete?

The museum should preserve the work's source assets, code, engine environment, interaction logic, spatial measurements, device requirements and artist-approved substitutions. It may later migrate the work to new hardware, emulate an older environment or reconstruct the experience. The artist and institution need to identify which properties are essential: exact visual quality, embodied scale, interaction, social presence, timing or a specific device. Preservation is an interpretive process, so every migration should be documented.

5. Does a realistic digital reconstruction prove what a lost object or site looked like?

No. Realism can conceal uncertainty. A responsible reconstruction distinguishes measured evidence, archival documentation, expert inference and imaginative completion. It should explain missing data and allow relevant communities to contribute interpretation. Photorealistic detail is a visual style, not proof. In contested or culturally sensitive cases, the system should show where knowledge ends rather than filling every gap with a seamless surface.

6. What data can an immersive artwork collect about visitors?

Depending on the system, it may process head and hand movement, gaze, voice, room geometry, location, interaction history and account information. Some systems can infer attention, emotion or biometric characteristics. Institutions should minimize collection, explain what is necessary, avoid retaining data without a clear purpose and provide access alternatives when possible. Cultural settings do not exempt spatial technology from privacy and consent responsibilities.