If your oven door doesn't have holes you can insert a cleaning tool through, you may have to take your oven door apart to clean it. You can typically learn how to do this in your oven's user manual, which you should be able to find online by searching your oven's manufacturer, make, and model number.