You need to right click on the Rack application icon in the Applications folder (or wherever you have placed it), then select Open.
You only need to do this once. After that, Rack will open as normal.
Please also see the FAQ in this post: An unofficial guide to the Rack v1 Changelog
And welcome! 