Minimize casts to pointers #1891

Job	Run time
Check	27s
Format	24s
Build	28s
Check docs	27s
Clippy	41s
Test	1m 24s
Run (x86_64, rusty_demo, none, dev)	1m 53s
Run (x86_64, rusty_demo, none, release)	1m 34s
Run Hermit for Rust (x86_64 + kvm)	3m 45s
Run (x86_64, httpd, virtio-net-pci, dev)	1m 56s
Run (x86_64, httpd, virtio-net-pci, release)	2m 11s
Run (x86_64, httpd, rtl8139, dev)	1m 51s
Run (x86_64, httpd, rtl8139, release)	1m 36s
Run (x86_64, testudp, virtio-net-pci, dev)	1m 5s
Run (x86_64, testudp, virtio-net-pci, release)	1m 8s
Run (x86_64, testudp, rtl8139, dev)	1m 14s
Run (x86_64, testudp, rtl8139, release)	1m 4s
Run (x86_64, hello_world, none, dev)	2m 6s
Run (x86_64, hello_world, none, release)	2m 7s
Run (aarch64, rusty_demo, none, dev)	2m 47s
Run (aarch64, rusty_demo, none, release)	2m 45s
Run (aarch64, httpd, virtio-net-pci, dev)	2m 47s
Run (aarch64, httpd, virtio-net-pci, release)	2m 59s
Run (aarch64, testudp, virtio-net-pci, dev)	2m 39s
Run (aarch64, testudp, virtio-net-pci, release)	2m 42s
	44m 0s

Provide feedback