Ka’ba is the Qibla i.e. the direction muslims face during their prayers. It is important to note that though muslims face the Kaaba during prayers, they do not worship the Kaaba. Muslims worship and bow to none but Allah:
We see the turning of your face (for guidance) to the heavens: now shall We turn you to a Qiblah that shall please you. Turn then your face in the direction of the Sacred Mosque: wherever you are, turn your faces in that direction. (Quran 2:144)
Islam believes in fostering unity For instance, if muslims want to offer prayer, it is possible that some may wish to face north, while some may wish to face south. In order to unite muslims in their worship of the One True God, muslims, wherever they may be, are asked to face in only one direction i.e. towards the Kaaba. If some muslims live towards the west of the Kaaba they face the east. Similarly if they live towards the east of the Kaaba they face the west.