AVPoller will consume more CPU if you have set it up to poll "large number of devices" "frequently" in your inventory. There is nothing wrong with this behavior of AVPoller. If your system performance is degraded by availability polling,the following are the workarounds:
1)Add more CPU
2)Poll fewer devices
3)Poll less frequently
So, unless you are making any changes to the device hardware very frequently, you can turn off the AVPoller so that the CPU Utilization becomes less. Also if you have many devices/views you have set up for polling, then try disabling some of them. This will also reduce the CPU usage.