Implicit Modeling of Non-rigid Objects with Cross-Category Signals