Poly(N-isopropylacrylamide) (PNIPAM) is one of the most well studied thermoresponsive polymers and its microgels undergo a reversible volume phase transition (VPT) at temperatures close to that of the human body. Coupling this property with the unique optical properties of single-walled carbon nanotubes (SWCNT) in the near infrared (NIR) leads to interesting nanohybrids that could be used as multi-responsive sensors/actuators for biological applications. We show the synthesis of thermoresponsive SWCNT/PNIPAM hybrids using two different non-covalent strategies, preserving the nanotube optical properties such as fluorescence. The first strategy involves the dispersion of the SWCNT in water with sodium dodecyl sulfate (SDS), and subsequent in situ synthesis of PNIPAM microgels inside the SDS coatings around the nanotubes. The second strategy starts with modifying the nanotubes with a pyrene derivative, which in turn is used as the starting point for the in situ polymerization of the PNIPAM microgels, thus ensuring that the polymer grows around the nanotubes. In both cases, we obtain hybrids showing a phase transition at temperatures close to that of the human body, with the absorption and fluorescence spectra of the hybrids in the NIR changing in response to the changing dielectric environment. These systems could be used as actuators/sensors in biological systems.