The recent outbreak of Zika virus (ZIKV) disease caused an enormous number of infections in Central and South America, and the unusual increase in the number of infants born with microcephaly associated with ZIKV infection aroused global concern. Here, we developed a reverse transcription loop-mediated isothermal amplification (RT-LAMP) assay using a portable device for the detection of ZIKV. The assay specifically detected ZIKV strains of both Asian and African genotypes without cross-reactivity with other arboviruses, including Dengue and Chikungunya viruses. The assay detected viral RNA at 14.5 TCID50/mL in virus-spiked serum or urine samples within 15 min, although it was slightly less sensitive than reference real time RT-PCR assay. We then evaluated the utility of this assay as a molecular diagnostic test using 90 plasma or serum samples and 99 urine samples collected from 120 suspected cases of arbovirus infection in the states of Paraíba and Pernambuco, Brazil in 2016. The results of this assay were consistent with those of the reference RT-PCR test. This portable RT-LAMP assay was highly specific for ZIKV, and enable rapid diagnosis of the virus infection. Our results provide new insights into ZIKV molecular diagnostics and may improve preparedness for future outbreaks.