Yes you have to take Registration under GST
In GST if we make even a single Ruppee Supply in interstate we have to get registered
You are right export are zero rated but for seamless flow of credit govt make these provisions
In this you have to options
Export without charging tax and can apply for input refund
Export with tax and got full refund of tax charged (coz input already adjusted with output tax liabilities)