Is it possible to combine jinja templates in ansible like this is possible with erbs in puppet?
Yes, that is possible according to this post.

When a second jinja template was created and this was included in the base jinja it was called.

{% include "checks/subdue.j2" %}