Sure, you can! I do as well. If your coconut oil is solid, you'll have to use gentle heat to get it to liquefy and infuse. Unless you're looking for your infusion to target a specific condition or have a specific flavor, then the oil that you use is largely up to you. Just remember to use food safe oils for anything that you intend to ingest.