This pilot study serves as a starting point to explore the process of finding and evaluating YouTube videos for non-technical skills training for crew resource management courses. Five videos on situation awareness were identified using a combination of Boolean search strategies, relevance of the content and ratings from YouTube users. In the next step, the videos were evaluated, showing variations in education quality between videos. Moreover, preliminary finding show that user-generated comments and ratings might be of little use for guiding the search for high-quality content on YouTube. A closer analysis of the content shows how tensions between scientific concepts and practical illustrations of situation awareness is seen in the videos. This might create a dilemma for teachers in choosing between theoretically complete and authentic content. Research that further explores the ways discursive transformations of human factors concepts occur through everyday uses in popular media such as YouTube is suggested.