Tan Sri Dato' Seri Hj. Ab. Rashid joined the Malaysian Civil Service in 1967 and has served numerous departments and ministries. Some of the more important posts held include:

1968 - 69 : Assistant Secretary, Public Services Commission
1972 - 75 : Principal Assistant Secretary, Department of Immigration
1975 - 76 : Secretary, Melaka Town Council
1977 - 79 : Deputy Director General of Local Government
1979 - 95 : Secretary of Election Commission
1995 - 97 : Deputy Secretary of Ministry of Education
2001 to now : Chairman of Election Commission

Tan Sri Dato' Seri Hj. Ab. Rashid has also served as an Advisor to the Commonwealth Secretariat in connection with election affairs.