Programmed death 1/programmed death ligand 1 (PD-L1) axis inhibitors have been proven effective, especially in patients with tumors expressing PD-L1. Their clinical efficacy in patients with EGFR-activating mutations is still unclear, whereas KRAS mutations seem to be associated with good response. We used multiplexed quantitative immunofluorescence to investigate PD-L1 expression and to characterize tumor infiltrating lymphocyte (TIL) populations and their activation status in more than 150 NSCLC patients with known mutation status. PD-L1 expression was significantly lower in EGFR-mutant compared to KRAS-mutant, and EGFR/KRAS wild-type (WT) tumors. KRAS mutant tumors were more inflamed with higher CD4+, CD8+ and CD20+ TILs. Subgroup analysis by TIL activation status revealed that EGFR mutants had a high frequency of inactive TILs even though lymphocytes were present in the tumor microenvironment. In contrast, in KRAS mutants, when TILs were present they were almost always active. Additionally, we found differences between EGFR mutation sites in CD8+ expression and the TIL activation profile. Finally, activated EGFR correlated with increased PD-L1 expression in EGFR mutants but not in EGFR WT, whereas TIL activation was associated with higher PD-L1 only in EGFR/KRAS WT. Our findings show the unique immune profile of EGFR-mutant tumors. The high frequency of inactive TILs could explain the low immunotherapy response rates in these patients, whereas PD-L1 as a predictive biomarker may reflect the constitutive oncogenic signaling rather than immune signaling, which would be associated with high PD-L1 levels and TILs activation.