Aim: Pre-hospital triage by paramedics could determine which patients qualify for direct transport to comprehensive stroke centres for mechanical thrombectomy. For triage to be successful, paramedics have to be able to identify major neurological impairments. The aim of our study was to determine inter-rater reliability between paramedics and stroke neurologists in identifying severe hemiparesis in acute stroke pat lents. Methods: In this prospective, multicentre study, 225 paramedics from Emergency Medical Services were taught via e-learning to distinguish between mild and severe hemiparesis. Inter-rater agreement between paramedics and stroke specialists in evaluating the degree of hemiparesis (National Institutes of Health Stroke Scale [NIHSS], items 5 and 6, scoring 0-2 [none or mild] vs. 3-4 [severe]) was assessed using the unweighted K index. Results: Over the course of 10 months in 2016, 402 consecutive patients (average age 75 years) were evaluated for the presence of hemiparesis by paramedics during pre-hospital care and by stroke neurologists immediately after stroke centre admission. The total agreement between the paramedics and neurologists in their evaluations of severe hemiparesis or monoparesis was moderate: K 0.43 (95% Cl 0.36-0.50). Conclusion: We found moderate reproducibility of the identification of severe hemiparesis in acute stroke patients when assessed by paramedics in a pre-hospital setting. Better education for paramedics is needed before implementing a change in transport triage based on their assessment of severity of neurological deficit.