Sure you can look at it that way. I think the “internet” in the internet of things does not mean a direct “internet” connection. To me, it means connectivity.
Your IoT gas sensor or door sensor will probably not have WiFi and Ethernet but it is “connected” to the internet, via a gateway.
The pocket beagle is IoT because it has the IoT software and it has the buses you need to add connectivity options, like USB and SPI.
But why not just put WiFi on it? Because you may need cell, long range, Bluetooth, or over if the many new IoT focused connectivity technologies. No matter what you pick, the software is there ready for you.
So yeah, I see it IoT all the way, but that is just my opinion