our hadoop image won't run on modern kernels

[mmm]

The workaround is to have students:

sudo -s
echo 'GRUB_CMDLINE_LINUX_DEFAULT="vsyscall=emulate"' >> /etc/default/grub
update-grub
reboot

which sucks.

This is caused in cloudera/quickstart which our hadoop image derives from.

So the fix is to find/fork/fix the source for the cloudera/quickstart image (which I think might be deprecated) :-/

[mmm]

not really sure how to fix this, so I'd love ideas

@BrainMonkey

[dschioberg]

How hard is it to update the whole stack we are using? Kafka and Spark are also hopelessly outdated and it's only a question of time when the setup breaks.

[penpen86]

I can help with the spark image, using a smaller version of the one we use in w261

…

On Wed, Apr 14, 2021 at 9:20 PM dschioberg ***@***.***> wrote: How hard is it to update the whole stack we are using? Kafka and Spark are also hopelessly outdated and it's only a question of time when the setup breaks. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#25 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEMIXZPLITVXCWUTI57TIU3TIY5MBANCNFSM426NH2NA> .

-- Vinicio De Sola Beiner +1 347 4011930

[BrainMonkey]

Same here, I just helped a student update Spark and Kafka for their project to take advantage of Spark 2.4 features

[BrainMonkey]

Not sure if helps or anything, but professionally we use a lot of the bitnami(https://bitnami.com/) images because they are throughly vetted and pass a lot of our initial security audits from the OS perspective.