Estimating physics from images: what real measurements reveal
Blog post from Hugging Face
ProjectSim evaluates image-based estimates of physical properties for reconstructed 3D assets—including mass, sliding friction, indentation hardness, and restitution—against measurements from the YCB, NeRF2Physics, and IDPP research datasets. Using mean min ratio error, where 1 indicates exact agreement, it reported scores of 0.761 for mass, 0.833 for friction, 0.807 for hardness, and 0.880 for restitution estimated from a single still frame; its mass and friction results exceeded tested density-based and constant-value baselines, while hardness was slightly below the cited PhysGS result. In reruns on YCB objects, ProjectSim achieved the strongest mass score among five compared methods, with 51 of 61 predictions within a factor of two of scale measurements. The analysis also notes that friction is contact-specific rather than solely an object property: fitting separate coefficients for objects and surfaces to measured contacts improved agreement from 0.794 to 0.931. The findings suggest that image-derived physical parameters may support more realistic robotics simulations for actions such as pushing, grasping, and dropping, while recognizing that material interactions and measurement contexts remain important.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 1 | 6,578 | 1,243 | 236 | +9% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.