Expensive models and experiments
PIML can reduce repeated simulation or experimental cost while retaining the governing knowledge used in Computing in Multimedia.
Engineering Research Community
Computing in Multimedia & Physics-Informed Machine Learning
Physics-grounded modelling, learning and validation for Computing in Multimedia
Computing in Multimedia combines image, video, audio, graphics, animation, interaction and immersive systems. Physical models are valuable because media are produced through light, optics, sound, motion, sensors, materials and human perception.
PIML can improve inverse rendering, reconstruction, acoustic inference and physically plausible animation. It must not be used to imply authenticity: physically plausible synthetic media may still be fabricated, and provenance requires separate security and governance.
This page presents ten focused research areas, degree-level project pathways, selected publications and direct support through the PIMLS biweekly members meeting.
This Computing in Multimedia guide covers Physics-Informed Neural Networks (PINNs), physics-guided machine learning, scientific machine learning, neural operators, hybrid models and engineering digital twins. Explore the research and project pathways below, then join the Physics-Informed Machine Learning Society to connect with the international PIMLS community.
The central ideaEstablished Computing in Multimedia knowledge + measurements and simulation + machine learning
10focused research areas
3academic project pathways
6selected publications
Biweeklymember research meeting
Why this combination matters
Why Computing in Multimedia Needs Physics-Informed Learning
Use available scientific knowledge to make limited data more useful, transparent and testable.
Incomplete engineering models
Learn uncertain parameters, closures or discrepancies around an inspectable mechanistic foundation.
Transfer across conditions
Test whether structured models generalize across geometries, materials, assets, operating regimes or sites.
Trustworthy evidence
Use physical residuals, independent measurements, uncertainty and conventional engineering baselines before deployment.
Ten focused directions
Major Computing in Multimedia PIML Research Areas
Each card connects a meaningful Computing in Multimedia question with suitable scientific knowledge, modelling choices and evidence needed to test it.
01
Inverse Rendering
Images entangle geometry, light and material. PIML opportunities: Use differentiable image formation with uncertainty and calibrated tests.
Model and evidenceGoverning equations, calibrated measurements and held-out operating conditions
02
3D Reconstruction
Multiple scenes explain sparse views. PIML opportunities: Enforce camera geometry and evaluate true geometric error.
Model and evidenceMechanistic and data-only baselines, uncertainty and independent validation
03
Physically Based Animation
Motion should respect mass, contact and elasticity. PIML opportunities: Learn simulation residuals and verify stability and energy behaviour.
Model and evidenceGeometry, material or system parameters, sensor data and physical residuals
04
Acoustic Source Localization
Microphones measure delayed wave mixtures. PIML opportunities: Embed propagation and array geometry in inverse inference.
Model and evidenceGoverning equations, calibrated measurements and held-out operating conditions
05
Room Acoustics
Surfaces and geometry shape impulse responses. PIML opportunities: Use wave/ray hybrids with real-room calibration.
Model and evidenceMechanistic and data-only baselines, uncertainty and independent validation
06
Computational Photography
Optics and sensor processing determine images. PIML opportunities: Co-design acquisition and reconstruction with a measured forward model.
Model and evidenceGeometry, material or system parameters, sensor data and physical residuals
07
Medical and Scientific Visualization
Rendered fields carry quantitative meaning. PIML opportunities: Preserve units, uncertainty and provenance through visualization.
Model and evidenceGoverning equations, calibrated measurements and held-out operating conditions
08
Virtual and Augmented Reality
Immersion requires consistent geometry, light and latency. PIML opportunities: Build physically anchored scene models with human-performance tests.
Model and evidenceMechanistic and data-only baselines, uncertainty and independent validation
09
Digital Humans
Appearance and motion must not erase identity or consent. PIML opportunities: Combine biomechanics with privacy and explicit authorization.
Model and evidenceGeometry, material or system parameters, sensor data and physical residuals
10
Multimodal Sensor Fusion
Audio, video and depth observe shared events. PIML opportunities: Use common geometry, timing and measurement models.
Model and evidenceGoverning equations, calibrated measurements and held-out operating conditions
Choose the right research depth
Projects for Every Academic Stage
Start with a scope that matches your time, mathematical background, experimental access and expected research contribution.
Project pathway 1
B.E./B.Tech
Learn the foundations with a bounded, measurable system.
- camera-aware deblurring
- acoustic localization PINN
- physics-verified cloth animation
- calibrated inverse-rendering benchmark
Expected outcome
A reproducible implementation, clear baselines, a manageable dataset and physically meaningful validation.
Project pathway 2
M.Tech
Combine an engineering model, substantial data and rigorous comparison.
- multimodal room digital twin
- uncertainty-aware 3D reconstruction
- differentiable optical system
- physically grounded AR scene model
Expected outcome
A thesis-quality study with held-out regimes, mechanistic and data-only baselines, ablation and uncertainty.
Project pathway 3
Ph.D.
Address a publishable methodological, multiscale or deployment research gap.
- foundation models for inverse media physics
- certifiable scientific visualization
- privacy-preserving digital humans
- multisensory physical world models
Expected outcome
New methodology or validated engineering insight, multi-regime evidence, reproducible software and journal publications.
From idea to evidence
A Strong PIML Project Workflow
01
Define
Choose one Computing in Multimedia question and a measurable engineering output.
02
Model
State the governing relationships, constraints or validated domain knowledge you will retain.
03
Compare
Build mechanistic and data-only baselines before the hybrid model.
04
Validate
Hold out experiments, conditions, assets, sites or regimes at the deployment level.
05
Publish
Report uncertainty, ablation, limitations, data lineage and reproducible code.
Read before you modelDiscuss Your Literature
Selected Publications and Why They Matter
Use this focused reading list to understand the general PIML framework, direct Computing in Multimedia evidence and suitable hybrid modelling methods.
Literature review advice
Do not list papers only. Compare the engineering question, incorporated knowledge, data, split strategy, baselines, uncertainty and evidence level.
This source is included in the Computing in Multimedia literature guide because it demonstrates or reviews a relevant physics-informed, hybrid, inverse, surrogate or scientific-machine-learning approach. Read the methods, data split, baselines and validation evidence—not only the reported accuracy.
How to use this paper: Use this paper to refine the research question, identify a defensible physical prior and compare evidence requirements for Computing in Multimedia.
Read publication or record This source is included in the Computing in Multimedia literature guide because it demonstrates or reviews a relevant physics-informed, hybrid, inverse, surrogate or scientific-machine-learning approach. Read the methods, data split, baselines and validation evidence—not only the reported accuracy.
How to use this paper: Use this paper to refine the research question, identify a defensible physical prior and compare evidence requirements for Computing in Multimedia.
Read publication or record This source is included in the Computing in Multimedia literature guide because it demonstrates or reviews a relevant physics-informed, hybrid, inverse, surrogate or scientific-machine-learning approach. Read the methods, data split, baselines and validation evidence—not only the reported accuracy.
How to use this paper: Use this paper to refine the research question, identify a defensible physical prior and compare evidence requirements for Computing in Multimedia.
Read publication or record This source is included in the Computing in Multimedia literature guide because it demonstrates or reviews a relevant physics-informed, hybrid, inverse, surrogate or scientific-machine-learning approach. Read the methods, data split, baselines and validation evidence—not only the reported accuracy.
How to use this paper: Use this paper to refine the research question, identify a defensible physical prior and compare evidence requirements for Computing in Multimedia.
Read publication or record This source is included in the Computing in Multimedia literature guide because it demonstrates or reviews a relevant physics-informed, hybrid, inverse, surrogate or scientific-machine-learning approach. Read the methods, data split, baselines and validation evidence—not only the reported accuracy.
How to use this paper: Use this paper to refine the research question, identify a defensible physical prior and compare evidence requirements for Computing in Multimedia.
Read publication or record This source is included in the Computing in Multimedia literature guide because it demonstrates or reviews a relevant physics-informed, hybrid, inverse, surrogate or scientific-machine-learning approach. Read the methods, data split, baselines and validation evidence—not only the reported accuracy.
How to use this paper: Use this paper to refine the research question, identify a defensible physical prior and compare evidence requirements for Computing in Multimedia.
Read publication or record Build an interdisciplinary team
Where Computing in Multimedia Can Collaborate
Computer Science
Scientific ML, optimization, trustworthy AI and reproducible research software.
Applied Mathematics
Differential equations, numerical methods, inverse problems and uncertainty.
Sensing & Control
Instrumentation, data acquisition, state estimation and responsible deployment.
Domain Laboratories
Experiments, calibration, validation evidence and practical expertise for Computing in Multimedia.
Before you begin
Frequently Asked Research Questions
These answers help students avoid common scope, terminology and validation mistakes.
Still have a question?
Use the biweekly meeting form for research guidance.
Request accessNo. Computing in Multimedia projects may use physics-guided features, hybrid residual models, differentiable simulators, neural operators, constrained architectures or data assimilation. State exactly what knowledge is incorporated.
Choose one engineering question, a measurable output and a defensible mechanistic baseline. Add learning only where data can identify an uncertainty or discrepancy.
A meaningful question, justified prior knowledge, deployment-level holdouts, strong baselines, ablation, uncertainty, reproducibility and honest limitations.
Simulation can broaden coverage, but simulation-only evidence cannot establish real-system accuracy. Use calibrated experiments, field measurements or trusted independent references appropriate to the claim.
Submit the biweekly members meeting form to discuss your project level, branch, data, model, validation plan and possible collaborators.
Take the next step
Bring your Computing in Multimedia research idea to PIMLS
Join the biweekly members meeting for project guidance, collaboration and publication planning—or contact the Society directly.
Meeting participation is requested through the Google form. Complete it carefully so the Society can understand your research interest.