Categories on SeHe's Blog

Speed Comparision on some Modern GIS tools

Sat, 28 Sep 2024 00:00:00 +0000

SeHe's Blog https://example.org/posts/speed_comparision_gis_intersection/ -

GIS can change with current technology as Apache Arrow, and perhaps also Apache Spark und Apache Sedona. + https://sehheiden.github.io/posts/speed_comparision_gis_intersection/ + SeHe's Blog https://sehheiden.github.io/posts/speed_comparision_gis_intersection/ -

GIS can change with current technology as Apache Arrow, and perhaps also Apache Spark und Apache Sedona. Also in Pythonland Geopandas enhanced performance over time. In addition, I also wanted to try Dask und DuckDB.

Please contact me, when you read this and think I could have increased the code quality and speed. I use some public data, which still widely use shape files in Germany.

@@ -187,18 +187,18 @@ Geopandas.

I want to get it working both with Scala and PySpark.

Expectation: Some loss due to virtualization with Docker. So the PySpark would be not as fast as Dask? But Scala could be faster?!

-- https://example.org/posts/speed_comparision_gis_intersection/ -

LDA and WordCloud on Mastodon Posts for the Bavarian State Election!

Sat, 04 May 2024 00:00:00 +0000

SeHe's Blog https://example.org/posts/mastodonbavarian_election_lda/ -

We selected a party as the dominant party, when this party or its + https://sehheiden.github.io/posts/mastodonbavarian_election_lda/ + SeHe's Blog https://sehheiden.github.io/posts/mastodonbavarian_election_lda/ -

Contrary to our hopes, there is no correlation between the topics and the sentiment. This might be caused, by the fact that topics are very similar, or that we attribute posts to a party by its dominant party.

-- https://example.org/posts/mastodonbavarian_election_lda/ -

Mastodon - Election Predictions

Fri, 15 Dec 2023 00:00:00 +0000

SeHe's Blog https://example.org/posts/mastodon_on_bavarian_elecvtion/ -

I held a presentation on this project on Elixir MeetUp Berlin on Feb 8th, 2024. The slides can be found here.

+ https://sehheiden.github.io/posts/mastodon_on_bavarian_elecvtion/ + SeHe's Blog https://sehheiden.github.io/posts/mastodon_on_bavarian_elecvtion/ -

I held a presentation on this project on Elixir MeetUp Berlin on Feb 8th, 2024. The slides can be found here.

The Livebook code can be found here. The code for data collection can be found here.

Abstract

@@ -1302,18 +1302,18 @@ Pérez, Juan Manue;, Rajngewerc Mariela; Giudici, Juan Carlos; Furman, Damián A -- https://example.org/posts/mastodon_on_bavarian_elecvtion/ -

Least Cost Path for Optimisation on Paths for Power Cables in North Germany

Wed, 15 Mar 2023 00:00:00 +0000

SeHe's Blog https://example.org/posts/cableroute/ -

Introduction and Objectives

+ https://sehheiden.github.io/posts/cableroute/ + SeHe's Blog https://sehheiden.github.io/posts/cableroute/ -

Introduction and Objectives

-- https://example.org/posts/cableroute/ -

Speed Comparision on some Modern GIS tools

Sat, 28 Sep 2024 00:00:00 +0000

Please contact me, when you read this and think I could have increased the code quality and speed. I use some public data, which still widely use shape files in Germany.

The Data

First I load fhe ALKIS (register) building data for all counties in the state of Brandenburg. All vector files are open data. The victor files are still offered as Shapefiles. From the ALKIS Dataset of Brandenburg I used the buildings and the parcels (with land usage). The files are stored per county! The geometries have some errors which Geopandas auto-detects and fixes. In addition, some file can not be opened with the fiona library from Geopandas, with the error message of multiple geometry columns. Hence, we always use de new default: pyogrio.

LDA and WordCloud on Mastodon Posts for the Bavarian State Election!

Sat, 04 May 2024 00:00:00 +0000

We selected a party as the dominant party, when this party or its candidate was mentioned 50 % or more compared to other parties. But this results in many posts that mention the candidates Söder, Aiwanger, although the post is attribute to different parties. This mixed attribution, which allows to mention different parties as long as there is a clear dominant party, makes attribution hard, but was used to keep as many posts as possible. Even though in some weeks we did not record post for some smaller "dominant" parties.

Mastodon - Election Predictions

Fri, 15 Dec 2023 00:00:00 +0000

I held a presentation on this project on Elixir MeetUp Berlin on Feb 8th, 2024. The slides can be found here.

The Livebook code can be found here. The code for data collection can be found here.

Abstract

We try to predict voting result in the 2023 Bavarian state election in Germany by Mastodon posts.

The last polls before the election show an average error of about 0.7 to 0.9 percent per major party. A time weighted average of the polls of the last six weeks before the election reduced the error to 0.39 percentage points per party.

Least Cost Path for Optimisation on Paths for Power Cables in North Germany

Wed, 15 Mar 2023 00:00:00 +0000

Introduction and Objectives

The German power system is adding renewable energy sources in the north, where wind energy plants reach their highest efficiency, due to higher wind speeds. At the same time old power plants e.g. nuclear, hard coal and lignite are being phased out [^eser-frey_analyzing_2012]. These older power plants were mainly located in southern and central Germany. The energy sink, industrial and private demand, is not shifting north. Therefore, the renewable energy has to be transported from north to south which increases the congestion in the power grid. The amount of offshore wind power, that the German energy system can use, can be greatly increased by adding new power lines ¹.