Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance the query performance and storage size of the Cassandra storage in v3 server #3584

Merged
merged 1 commit into from
Nov 7, 2023

Conversation

mrproliu
Copy link
Contributor

@mrproliu mrproliu commented Nov 7, 2023

  1. Improve collect throughput: Change the synchronous writing of batch data synchronization to asynchronous writing.
  2. Reducing Unnecessary Fields: Reduce unnecessary field storage to reduce storage space usage.
  3. Query Optimization: Split the original query method into multiple files, so that each query can be optimized better.

@mrproliu mrproliu added this to the 3.0.0 milestone Nov 7, 2023
final String columnName = model.getColumns().get(i).getColumnName().getStorageName();
if (StorageData.TIME_BUCKET.equals(columnName) ||
ZipkinSpanRecord.TIMESTAMP_MILLIS.equals(columnName) ||
JDBCTableInstaller.TABLE_COLUMN.equals(columnName)) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CassandraTableInstaller is referring to the JDBC implementation? Where does this TABLE COLUMN come from?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CassandraTableInstaller is referring to the JDBC implementation?

Nope, For now, the table installer only caches the table metadata.

Where does this TABLE COLUMN come from?

There are definitions in skywalking core that are not necessary for the query.

@wu-sheng wu-sheng merged commit 44b8c06 into openzipkin:zipkin-v3 Nov 7, 2023
7 checks passed
@mrproliu mrproliu deleted the cassandra-performance branch November 7, 2023 11:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants