Use both set screws. The one 90* to the key is nylon tipped so as not to mark the shaft.