Yes you can,
The “Royalty free license” grands you some “limited rights” to use the work in commercial or non commercial projects. This includes film, animations, commercials (video production in general) and to some extend games.
Your in violation with the license the moment you give access to the files via repackaging or redistribution. There are some exceptions for games, for example when its in proprietary format and measures are in place to prevent the end users from gaining access to the work. Selling the work as in game goods is also prohibited.
So your good to go using standard Royalty free licensed models in whatever video.
There can however be some exceptions, for example some creators may provide a custom license to impose some extra limits. For example my license clearly prohibits using the work to produce stock-video or NFT’s (crypto art). The standard Royalty free license in its current form does not clearly prohibit this although it mentions sub-licensing is not allowed. The problem is, most people don't know what that means.