The impact of hydrogeological disasters on people with disabilities is a complex issue for many reasons. In addition to the diversity of disabilities, each category representing a unique case of exposure and challenges, another crucial point for inclusive disaster policies is to understand how to reliably measure exposure and risks for different types of disability. In this short piece, three in-depth interviews with organizations working with individuals with severe cognitive disabilities on the autistic spectrum (PCDs) will be used to define how the concept of territory and safety affect the challenges PCDs and their families in case of hydrogeological risks in Japan and Italy. The main challenges identified are comprehension of risk, adaptation to evacuation scenarios, and lack of ad hoc information. To address these challenges, the importance of authorities, local communities, and organizations were highlighted, as well as disaster preparedness procedures and innate capabilities of families. Ultimately, this piece argues that the definition of territory and safety is insufficient to adequately represent the experience of PCDs and their families and should include familiarity with the space and the people that inhabit it.