Projects  /  Simulation  /  PINN for Motion Prediction
Simulation Jan – Feb 2025

Physics-Informed Neural Network for Object Motion Prediction

PINN models incorporating physical priors for predicting object motion under push/pluck manipulation — improving simulation fidelity and generalization.

TensorFlowPINNPhysics-Informed MLPythonManipulationSimulation
← Back to Projects

Overview

Physics-Informed Neural Networks embed known physical laws directly into the training process via the loss function, constraining model predictions to be consistent with dynamics equations. This project applies PINNs to the problem of predicting object motion under robotic push and pluck manipulation actions.

Approach

Physical Prior Integration: The equations of motion (Newton-Euler dynamics, friction models) are incorporated as soft constraints in the PINN loss function alongside the data-fitting loss. This forces the network to learn representations consistent with known physics, improving extrapolation beyond the training distribution.

Feature Engineering: Engineered features encoding contact geometry, mass distribution estimates, and surface material properties are used as network inputs to inform predictions.

Push/Pluck Scenarios: The model was trained and validated on simulated push and pluck manipulation scenarios with diverse object geometries and surface types.

Results

PINNPhysics constraints
Push/PluckManipulation scenarios
ImprovedSim fidelity

PINN models demonstrated improved simulation fidelity compared to pure data-driven baselines, particularly in out-of-distribution scenarios with novel object masses and friction coefficients. Physical constraints prevented unphysical predictions common in unconstrained neural nets.

Media

🎥 Demo video and project images coming soon.