Abstract: Detecting and removing pesticide and veterinary drug residues in agricultural products are important for ensuring food safety. Current methods for detecting pesticide residues are mainly relied on sophisticated instruments, which require long detection time and skilled operators, limiting their accessibility. Metal-Organic Frameworks (MOFs) are a hybrid material composed of metal ions/clusters and organic ligands. MOFs possess multiple functions such as adsorption enrichment, catalytic degradation, and fluorescent and electrochemical signal generation. Therefore, MOFs have great potential in rapidly detecting and removing pesticide and veterinary drug residues. This review introduces functionalities of MOFs: Enrichment and removal, catalytic degradation, fluorescence sensing, and electrochemical sensing, and then summarizes their applications for rapid detecting and removing pesticide and veterinary drug residues. Additionally, this article comprehensively analyzes the advantages and disadvantages about combining RGB analysis and portable monitoring devices with MOFs. Also, the challenges of applying MOFs to detecting and removing pesticide and veterinary drug residue are discussed. Overall, this paper provides a reference for developing techniques to rapidly detect and remove containments in agricultural products.