The pair have said the new department will repeal thousands of regulations and drastically reduce the federal workforce.