The anaplastic lymphoma kinase (ALK, CD247) is a potential target for antibody-based therapy. However, no antibody-based therapeutics targeting ALK have entered clinical trials, necessitating the development of novel antibodies with unique therapeutic merits. Single-domain antibodies (sdAb) bear therapeutic advantages compared to the full-length antibody including deeper tumor penetration, cost-effective production and fast washout from normal tissues. In this study, we identified a human immunoglobulin heavy chain variable domain (VH domain) (VH20) from an in-house phage library. VH20 exhibits good developability and high specificity with no off-target binding to ~6000 human membrane proteins. VH20 efficiently bound to the glycine-rich region of ALK with an EC of 0.4 nM and a KD of 6.54 nM. Both VH20-based bispecific T cell engager (TCE) and chimeric antigen receptor T cells (CAR Ts) exhibited potent cytolytic activity to ALK-expressing tumor cells in an ALK-dependent manner. VH20 CAR Ts specifically secreted proinflammatory cytokines including IL-2, TNFα and IFNγ after incubation with ALK-positive cells. To our knowledge, this is the first reported human single-domain antibody against ALK. Our in vitro characterization data indicate that VH20 could be a promising ALK-targeting sdAb with potential applications in ALK-expressing tumors, including neuroblastoma (NBL) and non-small cell lung cancer.