Chairman, M. Venkaiah Naidu, administered the oath of secrecy to both the BJP leaders.
This is Amit Shah's debut in the Parliament and was elected to the Upper House from Gujarat earlier this month.
Shah has been a five-term MLA in the Gujarat Assembly.
Congress leader Ahmed Patel also won in the Gujarat elections, even though few legislators deserted the party days before the election and cross-voting.
The BJP lacks majority in the House and it is being said that Shah's entry into the Rajya Sabha would give a boost to the party.