Internet of Things (IoT) and Industrial IoT (IIoT) devices share a big part in the market of computational devices. These mostly low cost devices lack security features, which makes them vulnerable to multiple malware families. There exist solutions for the detection of malware in IoT/IIoT systems. However, these solutions have multiple disadvantages, and hardware or software vendors do not finally use them to protect their systems. This thesis aims to study the disadvantages of the proposed solutions, and propose a new solution that can be implemented in resource constraint environments such as the IoT devices.