- Add arm64 support for binaries and make architecture configurable in docker images. (#2176, @MrXinWang)
-
Remove Tchannel between agent and collector (#2115, #2112, @pavolloffay)
Remove
Tchannel
port (14267) from collector andTchannel
reporter from agent.These flags were removed from agent:
--collector.host-port --reporter.tchannel.discovery.conn-check-timeout --reporter.tchannel.discovery.min-peers --reporter.tchannel.host-port --reporter.tchannel.report-timeout
These flags were removed from collector:
--collector.port
-
Normalize CLI flags to use host:port addresses (#1827, @annanay25)
Flags previously accepting listen addresses in any other format have been deprecated:
collector.port
is superseded bycollector.tchan-server.host-port
collector.http-port
is superseded bycollector.http-server.host-port
collector.grpc-port
is superseded bycollector.grpc-server.host-port
collector.zipkin.http-port
is superseded bycollector.zipkin.host-port
admin-http-port
is superseded byadmin.http.host-port
- Add grpc storage plugin OTEL exporter (#2229, @pavolloffay)
- Add OTEL ingester component (#2225, @pavolloffay)
- Add Kafka OTEL receiver/ingester (#2221, @pavolloffay)
- Create Jaeger OTEL agent component (#2216, @pavolloffay)
- Merge hardcoded/default configuration with OTEL config file (#2211, @pavolloffay)
- Support periodic refresh of sampling strategies (#2188, @defool)
- Add Elasticsearch OTEL exporter (#2140, @pavolloffay)
- Add Cassandra OTEL exporter (#2139, @pavolloffay)
- Add Kafka OTEL storage exporter (#2135, @pavolloffay)
- Clock skew config (#2119, @joe-elliott)
- Introduce OpenTelemetry collector (#2086, @pavolloffay)
- Support regex tags search for Elasticseach backend (#2049, @annanay25)
- Do not skip service/operation indexing for firehose spans (#2242, @yurishkuro)
- Add build information to OTEL binaries (#2237, @pavolloffay)
- Enable service default sampling param (#2230, @defool)
- Add Jaeger OTEL agent to docker image upload (#2227, @ning2008wisc)
- Support adding process tags in OTEL via env variable (#2220, @pavolloffay)
- Bump OTEL version and update exporters to use new API (#2196, @pavolloffay)
- Support sampling startegies file flag in OTEL collector (#2195, @pavolloffay)
- Add zipkin receiver to OTEL collector (#2181, @pavolloffay)
- Add Dockerfile for OTEL collector and publish latest tag (#2167, @pavolloffay)
- Run OTEL collector without configuration file (#2148, @pavolloffay)
- Update gocql to support AWS MCS (#2133, @johanneswuerbach)
- Return appropriate gRPC errors/codes to indicate request status (#2132, @yurishkuro)
- Remove tchannel port from dockerfile and test (#2118, @pavolloffay)
- Remove tchannel between agent and collector (#2115, @pavolloffay)
- Move all tchannel packages to a single top level package (#2112, @pavolloffay)
- UI pinned to version 1.9.0. The changelog is available here v1.9.0
- Fix enable Kafka TLS when TLS auth is specified #2107, @pavolloffay)
- Migrate project to go modules #2098, @pavolloffay)
- Do not skip service/operation indexing for firehose spans #2090, @yurishkuro)
- Close the span writer on main (#2096, @jpkrohling)
- Improved graceful shutdown - Collector (#2076, @jpkrohling)
- Improved graceful shutdown - Agent (#2031, @jpkrohling)
- UI pinned to version 1.8.0. The changelog is available here v1.8.0
- [tracegen] Add service name as a command line option (#2080, @kevinearls)
- Allow the Configuration of Additional Headers on the Jaeger Query HTTP API (#2056, @joe-elliott)
- Warn about time adjustment in tags (#2052, @bobrik)
- Add CLI flags for Kafka batching params (#2047, @apm-opentt)
- Added support for dynamic queue sizes (#1985, @jpkrohling)
- [agent] Process data loss stats from clients (#2010, @yurishkuro)
- Add /api/sampling endpoint in collector (#1990, @RickyRajinder)
- Add basic authentication to Kafka storage (#1983, @chandresh-pancholi)
- Make operation_strategies part also be part of default_strategy (#1749, @rutgerbrf)
- Upgrade gRPC to ^1.26 (#2077, @yurishkuro)
- Remove pkg/errors from dependencies (#2073, @yurishkuro)
- Update dependencies, pin grpc<1.27 (#2072, @yurishkuro)
- Refactor collector mains (#2060, @jpkrohling)
- Clarify that "kafka" is not a real storage backend (#2066, @yurishkuro)
- Added -trimpath option to go build (#2064, @kadern0)
- Use memory size flag to activate dyn queue size feature (#2059, @jpkrohling)
- Add before you push to the queue to prevent race condition on size (#2044, @joe-elliott)
- Count received batches from conforming clients (#2030, @yurishkuro)
- [agent] Do not increment data loss counters on the first client batch (#2028, @yurishkuro)
- Allow raw port numbers for UDP servers (#2025, @yurishkuro)
- Publish tracegen (#2022, @jpkrohling)
- Build binaries for Linux on IBM Z / s390x architecture (#1982, @prankkelkar)
- Admin/Query: Log the real port instead of the provided one to enable the use of port 0 (#2002, @ChadiEM)
- Split agent's HTTP server and handler (#1996, @yurishkuro)
- Clean-up collector handlers builder (#1991, @yurishkuro)
- Added 'resize' operation to BoundedQueue (#1948, @jpkrohling)
- Add common TLS configuration (#1838, @backjo)
- UI pinned to version 1.7.0. The changelog is available here v1.7.0
- Endpoint changes:
- Both Http & gRPC servers now take new optional parameter
spanKind
in addition toservice
. When spanKind is absent or empty, operations from all kinds of spans will be returned. - Instead of returning a list of string, both Http & gRPC servers return a list of operation struct. Please
update your client code to process the new response. Example response:
curl 'http://localhost:6686/api/operations?service=UserService&spanKind=server' | jq { "data": [{ "name": "UserService::getExtendedUser", "spanKind": "server" }, { "name": "UserService::getUserProfile", "spanKind": "server" }], "total": 2, "limit": 0, "offset": 0, "errors": null }
- The legacy http endpoint stay untouched:
/services/{%s}/operations
- Both Http & gRPC servers now take new optional parameter
- Storage plugin changes:
- Memory updated to support spanKind on write & read, no migration is required.
- Badger & ElasticSearch
to be implemented:
For nowspanKind
will be set as empty string during read & write, onlyname
will be valid operation name. - Cassandra updated to support spanKind on write & read (#1937, @guo0693):
If you don't run the migration script, nothing will break, the system will used the old tableoperation_names
and set emptyspanKind
in the response.
Steps to get the updated functionality:- You will need to run the command below on the host where you can use
cqlsh
to connect to Cassandra:The script will create new tableKEYSPACE=jaeger_v1 CQL_CMD='cqlsh host 9042 -u test_user -p test_password --request-timeout=3000' bash ./v002tov003.sh
operation_names_v2
and migrate data from the old table.
spanKind
column will be empty for those data.
At the end, it will ask you whether you want to drop the old table or not. - Restart ingester & query services so that they begin to use the new table
- You will need to run the command below on the host where you can use
Trace and Span IDs are always padded to 32 or 16 hex characters with leading zeros (#1956, @yurishkuro)
Previously, Jaeger backend always rendered trace and span IDs as the shortest possible hex string, e.g. an ID
with numeric value 255 would be rendered as a string ff
. This change makes the IDs to always render as 16 or 32
characters long hex string, e.g. the same id=255 would render as 00000000000000ff
. It mostly affects how UI
displays the IDs, the URLs, and the JSON returned from jaeger-query
service.
Motivation: Among randomly generated and uniformly distributed trace IDs, only 1/16th of them start with 0 followed by a significant digit, 1/256th start with two 0s, and so on in decreasing geometric progression. Therefore, trimming the leading 0s is a very modest optimization on the size of the data being transmitted or stored.
However, trimming 0s leads to ambiguities when the IDs are used as correlations with other monitoring systems, such as logging, that treat the IDs as opaque strings and cannot establish the equivalence between padded and unpadded IDs. It is also incompatible with W3C Trace Context and Zipkin B3 formats, both of which include all leading 0s, so an application instrumented with OpenTelemetry SDKs may be logging different trace ID strings than application instrumented with Jaeger SDKs (related issue #1657).
Overall, the change is backward compatible:
- links with non-padded IDs in the UI will still work
- data stored in Elasticsearch (where IDs are represented as strings) is still readable
However, some custom integration that rely on exact string matches of trace IDs may be broken.
Change default rollover conditions to 2 days (#1963, @pavolloffay)
Change default rollover conditions from 7 days to 2 days.
Given that by default Jaeger uses daily indices and some organizations do not keep data longer than 7 days the default of 7 days seems unreasonable - it might result in a too big index and running curator would immediately remove the old index.
- Support collector tags, similar to agent tags (#1854, @radekg)
- Support insecure TLS and only CA cert for Elasticsearch (#1918, @pavolloffay)
- Allow tracer config via env vars (#1919, @yurishkuro)
- Allow turning off tags/logs indexing in Cassandra (#1915, @joe-elliott)
- Blacklisting/Whitelisting tags for Cassandra indexing (#1904, @joe-elliott)
- Support custom basepath in HotROD (#1894, @jan25)
- Deprecate tchannel reporter flags (#1978, @objectiser)
- Do not truncate tags in Elasticsearch (#1970, @pavolloffay)
- Export SaveSpan to enable multiplexing (#1968, @albertteoh)
- Make rollover init step idempotent (#1964, @pavolloffay)
- Update python urllib3 version required by curator (#1965, @pavolloffay)
- Allow changing max log level for gRPC storage plugins (#1962, @yyyogev)
- Fix the bug that operation_name table can not be init more than once (#1961, @guo0693)
- Improve migration script (#1946, @guo0693)
- Fix order of the returned results from badger backend. (#1939, @burmanm)
- Update python pathlib to pathlib2 (#1930, @objectiser)
- Use proxy env vars if they're configured (#1910, @zoidbergwill)
- UI pinned to version 1.6.0. The changelog is available here v1.6.0
- Build platform binaries as part of CI (#1909, @yurishkuro)
- Upgrade and fix dependencies (#1907, @yurishkuro)
-
The default value for the Ingester's flag
ingester.deadlockInterval
has been changed to0
(#1868, @jpkrohling)With the new default, the ingester won't
panic
if there are no messages for the last minute. To restore the previous behavior, set the flag's value to1m
. -
Mark
--collector.grpc.tls.client.ca
flag as deprecated for jaeger-collector. (#1840, @yurishkuro)The deprecated flag will still work until being removed, it's recommended to use
--collector.grpc.tls.client-ca
instead.
- Support TLS for Kafka (#1414, @MichaHoffmann)
- Add ack and compression parameters for Kafka #1359 (#1712, @chandresh-pancholi)
- Propagate the bearer token to the gRPC plugin server (#1822, @radekg)
- Add Truncate and ReadOnly options for badger (#1842, @burmanm)
- Use correct context on ES search methods (#1850, @rubenvp8510)
- Handling of expected error codes coming from grpc storage plugins #1741 (#1814, @chandresh-pancholi)
- Fix ordering of indexScanKeys after TraceID parsing (#1809, @burmanm)
- Small memory optimizations in badger write-path (#1771, @burmanm)
- Set an empty value when a default env var value is missing (#1777, @jpkrohling)
- Decouple storage dependencies and bump Go to 1.13.x (#1886, @yurishkuro)
- Update gopkg.in/yaml.v2 dependency to v2.2.4 (#1865, @objectiser)
- Upgrade jaeger-client 2.19 and jaeger-lib 2.2 and prom client 1.x (#1810, @yurishkuro)
- Unpin grpc version and use serviceConfig to set the load balancer (#1786, @guanw)
- UI pinned to version 1.5.0. The changelog is available here v1.5.0
-
Create ES index templates instead of indices (#1627, @pavolloffay)
This can break existing Elasticsearch deployments if security policies are applied. For instance Jaeger
X-Pack
configuration now requires permission to create index templates -manage_index_templates
.
-
Add Elasticsearch version configuration to rollover script (#1769, @pavolloffay)
-
Add Elasticsearch version flag (#1753, @pavolloffay)
-
Add Elasticsearch 7 support (#1690, @gregoryfranklin)
The index mappings in Elasticsearch 7 are not backwards compatible with the older versions. Therefore using Elasticsearch 7 with data created with older version would not work. Elasticsearch 6.8 supports 7.x, 6.x, 5.x compatible mappings. The upgrade has to be done first to ES 6.8, then apply data migration or wait until old daily indices are removed (this requires to start Jaeger with
--es.version=7
to force using ES 7.x mappings for newly created indices).Jaeger by default uses Elasticsearch ping endpoint (
/
) to derive the version which is used for index mappings selection. The version can be overridden by flag--es.version
. -
Added support for hot reload of UI config (#1688, @jpkrohling)
-
Added base Grafana dashboard and Alert rules (#1745, @jpkrohling)
-
Add the jaeger-mixin for monitoring (#1668, @gouthamve)
-
Added flags for driving cassandra connection compression through config (#1675, @sagaranand015)
-
Support index cleaner for rollover indices and add integration tests (#1689, @pavolloffay)
-
Collector kafka producer protocol version config (#1658, @marqc)
-
Configurable kafka protocol version for msg consuming by jaeger ingester (#1640, @marqc)
-
Use credentials when describing keyspaces in cassandra schema builder (#1655, @MiLk)
-
Add connect-timeout for Cassandra (#1647, @sagaranand015)
- Fix gRPC over cmux and add unit tests (#1758, @yurishkuro)
- Add CA certificates to agent image (#1764, @yurishkuro)
- Fix badger merge-join algorithm to correctly filter indexes (#1721, @burmanm)
- Change Zipkin CORS origins and headers to comma separated list (#1556, @JonasVerhofste)
- Added null guards to 'Process' when processing an incoming span (#1723, @jpkrohling)
- Export expvar metrics of badger to the metricsFactory (#1704, @burmanm)
- Pass TTL as int, not as float64 (#1710, @yurishkuro)
- Use find by regex for archive index in index cleaner (#1693, @pavolloffay)
- Allow token propagation if token type is not specified (#1685, @rubenvp8510)
- Fix duplicated spans when querying Elasticsearch (#1677, @pavolloffay)
- Fix the threshold precision issue (#1665, @guanw)
- Badger filter duplicate results from a single indexSeek (#1649, @burmanm)
- Badger make default dirs work in Windows (#1653, @burmanm)
- UI pinned to version 1.4.0. The changelog is available here v1.4.0
-
The traces related metrics on collector now have a new tag
sampler_type
(#1576, @guanw)This might break some existing metrics dashboard (if so, users need to update query to aggregate over this new tag).
The list of metrics affected:
traces.received
,traces.rejected
,traces.saved-by-svc
. -
Remove deprecated index prefix separator
:
from Elastic (#1620, @pavolloffay)In Jaeger 1.9.0 release the Elasticsearch index separator was changed from
:
to-
. To keep backwards compatibility the query service kept querying indices with:
separator, however the new indices were created only with-
. This release of Jaeger removes the query capability for indices containing:
, therefore it's recommended to keep using older version until indices containing old separator are not queried anymore.
- Passthrough OAuth bearer token supplied to Query service through to ES storage (#1599, @rubenvp8510)
- Kafka kerberos authentication support for collector/ingester (#1589, @rubenvp8510)
- Allow Cassandra schema builder to use credentials (#1635, @PS-EGHornbostel)
- Add docs generation command (#1572, @pavolloffay)
- Fix data race between
Agent.Run()
andAgent.Stop()
(#1625, @tigrannajaryan) - Use json number when unmarshalling data from ES (#1618, @pavolloffay)
- Define logs as nested data type (#1622, @pavolloffay)
- Fix archive storage not querying old spans older than maxSpanAge (#1617, @pavolloffay)
- Query service: fix logging errors on SIGINT (#1601, @jan25)
- Direct grpc logs to Zap logger (#1606, @yurishkuro)
- Fix sending status to health check channel in Query service (#1598, @jan25)
- Add tmp-volume to all-in-one image to fix badger storage (#1571, @burmanm)
- Do not fail es-cleaner if there are no jaeger indices (#1569, @pavolloffay)
- Automatically set
GOMAXPROCS
(#1560, @rubenvp8510) - Add CA certs to all-in-one image (#1554, @chandresh-pancholi)
- UI pinned to version 1.3.0. The changelog is available here v1.3.0
-
The
kafka
flags were removed in favor ofkafka.producer
andkafka.consumer
flags (#1424, @ledor473)The following flags have been removed in the Collector and the Ingester:
--kafka.brokers --kafka.encoding --kafka.topic --ingester.brokers --ingester.encoding --ingester.topic --ingester.group-id
In the Collector, they are replaced by:
--kafka.producer.brokers --kafka.producer.encoding --kafka.producer.topic
In the Ingester, they are replaced by:
--kafka.consumer.brokers --kafka.consumer.encoding --kafka.consumer.topic --kafka.consumer.group-id
-
Add Admin port and group all ports in one file (#1442, @yurishkuro)
This change fixes issues #1428, #1332 and moves all metrics endpoints from API ports to admin ports. It requires re-configuring Prometheus scraping rules. Each Jaeger binary has its own admin port that can be found under
--admin-http-port
command line flag by running the${binary} help
command.
- Add gRPC resolver using external discovery service (#1498, @guanw)
- gRPC storage plugin framework (#1461, @chvck)
- Supports customized kafka client id (#1507, @newly12)
- Support gRPC for query service (#1307, @annanay25)
- Expose tls.InsecureSkipVerify to es.tls.* CLI flags (#1473, @stefanvassilev)
- Return info msg for
/health
endpoint (#1465, @stefanvassilev) - Add pprof endpoint to admin endpoint (#1375, @konradgaluszka)
- Add inbound transport as label to collector metrics #1446 (guanw)
- Sorted key/value store
badger
backed storage plugin (#760, @burmanm) - Add Admin port and group all ports in one file (#1442, @yurishkuro)
- Adds support for agent level tag (#1396, @annanay25)
- Add a Downsampling writer that drop a percentage of spans (#1353, @guanw)
- Sort traces in memory store to return most recent traces (#1394, @jacobmarble)
- Add span format tag for jaeger-collector (#1493, @guo0693)
- Upgrade gRPC to 1.20.1 (#1492, @guanw)
- Switch from counter to a gauge for partitions held (#1485, @bobrik)
- Add CORS handling for Zipkin collector service (#1463, @JonasVerhofste)
- Check elasticsearch nil response (#1467, @YEXINGZHE54)
- Disable sampling in logger -
zap
(#1460, @psinghal20) - New layout for proto definitions and generated files (#1427, @annanay25)
- Upgrade Go to 1.12.1 (#1437 ,@yurishkuro)
- UI pinned to version 1.2.0. The changelog is available here v1.2.0
-
Introduce
kafka.producer
andkafka.consumer
flags to replacekafka
flags (#1360, @ledor473)The following flags have been deprecated in the Collector and the Ingester:
--kafka.brokers --kafka.encoding --kafka.topic
In the Collector, they are replaced by:
--kafka.producer.brokers --kafka.producer.encoding --kafka.producer.topic
In the Ingester, they are replaced by:
--kafka.consumer.brokers --kafka.consumer.encoding --kafka.consumer.group-id
- Support secure gRPC channel between agent and collector (#1391, @ghouscht, @yurishkuro)
- Allow to use TLS with ES basic auth (#1388, @pavolloffay)
- Make
esRollover.py init
idempotent (#1407 and #1408, @pavolloffay) - Allow thrift reporter if grpc hosts are not provided (#1400, @pavolloffay)
- Deprecate colon in index prefix in ES dependency store (#1386, @pavolloffay)
- Make grpc reporter default and add retry (#1384, @pavolloffay)
- Use
CQLSH_HOST
in final call tocqlsh
(#1372, @funny-falcon)
- UI pinned to version 1.1.0. The changelog is available here v1.1.0
- Discover dependencies table version automatically (#1364, @black-adder)
- Separate query-service functionality from http handler (#1312, @annanay25)
- Remove cassandra SASI indices (#1328, @black-adder)
Migration Path:
- Run
plugin/storage/cassandra/schema/migration/v001tov002part1.sh
which will copy dependencies into a csv, update thedependency UDT
, create a newdependencies_v2
table, and write dependencies from the csv into thedependencies_v2
table. - Run the collector and query services with the cassandra flag
cassandra.enable-dependencies-v2=true
which will instruct jaeger to write and read to and from the newdependencies_v2
table. - Update spark job to write to the new
dependencies_v2
table. The feature will be done in #58. - Run
plugin/storage/cassandra/schema/migration/v001tov002part2.sh
which will DELETE the old dependency table and the SASI index.
Users who wish to continue to use the v1 table don't have to do anything as the cassandra flag cassandra.enable-dependencies-v2
will default to false. Users may migrate on their own timeline however new features will be built solely on the dependencies_v2
table. In the future, we will remove support for v1 completely.
- Support certificates in elasticsearch scripts (#1339, @pavolloffay)
- Add ES Rollover support to main indices (#1309, @pavolloffay)
- Load ES auth token from file (#1319, @pavolloffay)
- Add username/password authentication to ES index cleaner (#1318, @gregoryfranklin)
- Add implementation of FindTraceIDs function for Elasticsearch reader (#1280, @vlamug)
- Support archive traces for ES storage (#1197, @pavolloffay)
- Use Zipkin annotations if the timestamp is zero (#1341, @geobeau)
- Use GRPC round robin balancing even if only one hostname (#1329, @benley)
- Tolerate whitespaces in ES servers and kafka brokers (#1305, @verma-varsha)
- Let cassandra servers contain whitespace in config (#1301, @karlpokus)
- Change Elasticsearch index prefix from
:
to-
(#1284, @pavolloffay)
Changed index prefix separator from :
to -
because Elasticsearch 7 does not allow :
in index name.
Jaeger query still reads from old indices containing -
as a separator, therefore no configuration or migration changes are required.
- Add CLI configurable
es.max-num-spans
while retrieving spans from ES (#1283, @annanay25)
The default value is set to 10000. Before no limit was applied.
- Update to jaeger-lib 2 and latest sha for jaeger-client-go, to pick up refactored metric names (#1282, @objectiser)
Update to latest version of jaeger-lib
, which includes a change to the naming of counters exported to
prometheus, to follow the convention of using a _total
suffix, e.g. jaeger_query_requests
is now
jaeger_query_requests_total
.
Jaeger go client metrics, previously under the namespace jaeger_client_jaeger_
are now under
jaeger_tracer_
.
- Add gRPC metrics to agent (#1180, @pavolloffay)
The following metrics:
jaeger_agent_tchannel_reporter_batch_size{format="jaeger"} 0
jaeger_agent_tchannel_reporter_batch_size{format="zipkin"} 0
jaeger_agent_tchannel_reporter_batches_failures{format="jaeger"} 0
jaeger_agent_tchannel_reporter_batches_failures{format="zipkin"} 0
jaeger_agent_tchannel_reporter_batches_submitted{format="jaeger"} 0
jaeger_agent_tchannel_reporter_batches_submitted{format="zipkin"} 0
jaeger_agent_tchannel_reporter_spans_failures{format="jaeger"} 0
jaeger_agent_tchannel_reporter_spans_failures{format="zipkin"} 0
jaeger_agent_tchannel_reporter_spans_submitted{format="jaeger"} 0
jaeger_agent_tchannel_reporter_spans_submitted{format="zipkin"} 0
jaeger_agent_collector_proxy{endpoint="baggage",result="err"} 0
jaeger_agent_collector_proxy{endpoint="baggage",result="ok"} 0
jaeger_agent_collector_proxy{endpoint="sampling",result="err"} 0
jaeger_agent_collector_proxy{endpoint="sampling",result="ok"} 0
have been renamed to:
jaeger_agent_reporter_batch_size{format="jaeger",protocol="tchannel"} 0
jaeger_agent_reporter_batch_size{format="zipkin",protocol="tchannel"} 0
jaeger_agent_reporter_batches_failures{format="jaeger",protocol="tchannel"} 0
jaeger_agent_reporter_batches_failures{format="zipkin",protocol="tchannel"} 0
jaeger_agent_reporter_batches_submitted{format="jaeger",protocol="tchannel"} 0
jaeger_agent_reporter_batches_submitted{format="zipkin",protocol="tchannel"} 0
jaeger_agent_reporter_spans_failures{format="jaeger",protocol="tchannel"} 0
jaeger_agent_reporter_spans_failures{format="zipkin",protocol="tchannel"} 0
jaeger_agent_reporter_spans_submitted{format="jaeger",protocol="tchannel"} 0
jaeger_agent_reporter_spans_submitted{format="zipkin",protocol="tchannel"} 0
jaeger_agent_collector_proxy{endpoint="baggage",protocol="tchannel",result="err"} 0
jaeger_agent_collector_proxy{endpoint="baggage",protocol="tchannel",result="ok"} 0
jaeger_agent_collector_proxy{endpoint="sampling",protocol="tchannel",result="err"} 0
jaeger_agent_collector_proxy{endpoint="sampling",protocol="tchannel",result="ok"} 0
- Rename tcollector proxy metric in agent (#1182, @pavolloffay)
The following metric:
jaeger_http_server_errors{source="tcollector-proxy",status="5xx"}
has been renamed to:
jaeger_http_server_errors{source="collector-proxy",status="5xx"}
- Add tracegen utility for generating traces (#1245, @yurishkuro)
- Use DCAwareRoundRobinPolicy as fallback for TokenAwarePolicy (#1285, @vprithvi)
- Add Zipkin Thrift as kafka ingestion format (#1256, @geobeau)
- Add
FindTraceID
to the spanstore interface (#1246, @vprithvi) - Migrate from glide to dep (#1240, @isaachier)
- Make tchannel timeout for reporting in agent configurable (#1034, @gouthamve)
- Add archive traces to all-in-one (#1189, @pavolloffay)
- Start moving components of adaptive sampling to OSS (#973, @black-adder)
- Add gRPC communication between agent and collector (#1165, #1187, #1181 and #1180, @pavolloffay)
- Update exposed ports in ingester dockerfile (#1289, @objectiser)
- Upgrade Shopify/Sarama for proper handling newest kafka servers 2.x by ingester (#1248, @vprithvi)
- Fix sampling strategies overwriting service entry when no sampling type is specified (#1244, @objectiser)
- Fix dot replacement for int (#1272, @pavolloffay)
- Add C* query to error logs (#1250, @vprithvi)
- Add locking around partitionIDToState map accesses (#1239, @vprithvi)
- Reorganize config manager packages in agent (#1198, @pavolloffay)
- UI pinned to version 1.0.0. The changelog is available here v1.0.0
- Fix link in scatter plot when embed mode (#283, @aljesusg)
- Fix rendering X axis in TraceResultsScatterPlot - pass milliseconds to moment.js (#274, @istrel)
- Make agent timeout for reporting configurable and fix flags overriding (#1034, @gouthamve)
- Fix metrics handler registration in agent (#1178, @pavolloffay)
- Refactor agent configuration (#1092, @pavolloffay)
The following agent flags has been deprecated in order to support multiple reporters:
--collector.host-port
--discovery.conn-check-timeout
--discovery.min-peers
New flags:
--reporter.tchannel.host-port
--reporter.tchannel.discovery.conn-check-timeout
--reporter.tchannel.discovery.min-peers
- Various changes around metrics produced by jaeger-query: Names scoped to the query component, generated for all span readers (not just ES), consolidate query metrics and include result tag (#1074, #1075 and #1096, @objectiser)
For example, sample of metrics produced for find_traces
operation before:
jaeger_find_traces_attempts 1
jaeger_find_traces_errLatency_bucket{le="0.005"} 0
jaeger_find_traces_errors 0
jaeger_find_traces_okLatency_bucket{le="0.005"} 0
jaeger_find_traces_responses_bucket{le="0.005"} 1
jaeger_find_traces_successes 1
And now:
jaeger_query_latency_bucket{operation="find_traces",result="err",le="0.005"} 0
jaeger_query_latency_bucket{operation="find_traces",result="ok",le="0.005"} 2
jaeger_query_requests{operation="find_traces",result="err"} 0
jaeger_query_requests{operation="find_traces",result="ok"} 2
jaeger_query_responses_bucket{operation="find_traces",le="0.005"} 2
- Configurable deadlock detector interval for ingester (#1134, @marqc)
- Emit spans for elastic storage backend (#1128, @annanay25)
- Allow to use TLS certificates for Elasticsearch authentication (#1139, @clyang82)
- Add ingester metrics, healthcheck and rename Kafka cli flags (#1094, @ledor473)
- Add a metric for number of partitions held (#1154, @vprithvi)
- Log jaeger-collector tchannel port (#1136, @mindaugasrukas)
- Support tracer env based initialization in hotrod (#1115, @eundoosong)
- Publish ingester as binaries and docker image (#1086, @ledor473)
- Use Go 1.11 (#1104, @isaachier)
- Tag images with commit SHA and publish to
-snapshot
repository (#1082, @pavolloffay)
- Fix child span context while tracing cassandra queries (#1131, @annanay25)
- Deadlock detector hack for Kafka driver instability (#1087, @vprithvi)
- Fix processor overriding data in a buffer (#1099, @pavolloffay)
- Span Search - Highlight search results (#238), @davit-y
- Span Search - Improve search logic (#237), @davit-y
- Span Search - Add result count, navigation and clear buttons (#234), @davit-y
- Use correct duration format for scatter plot (#266), @tiffon)
- Fix collapse all issues (#264), @tiffon)
- Use a moderately sized canvas for the span graph (#257), @tiffon)
- Compare two traces (#228, @tiffon)
- Make tags clickable (#223, @divdavem)
- Directed graph as React component (#224, @tiffon)
- Timeline Expand and Collapse Features (#221, @davit-y)
- Integrate Google Analytics into Search Page (#220, @davit-y)
jaeger-standalone
binary has been renamed tojaeger-all-in-one
. This change also includes package rename fromstandalone
toall-in-one
(#1062, @pavolloffay)
- (Experimental) Allow storing tags as object fields in Elasticsearch for better Kibana support((#1018, @pavolloffay)
- Enable tracing of Cassandra queries (#1038, @yurishkuro)
- Make Elasticsearch index configurable (#1009, @pavolloffay)
- Add flags to allow changing ports for HotROD services (#951, @cboornaz17)
- (Experimental) Kafka ingester (#952, #942, #944, #940, @davit-y and @vprithvi))
- Use tags in agent metrics (#950, @eundoosong)
- Add support for Cassandra reconnect interval (#934, @nyanshak)
-
The storage implementations no longer write the parentSpanID field to storage (#856). If you are upgrading to this version, you must upgrade query service first!
-
Update Dockerfiles to reference executable via ENTRYPOINT (#815) by Zachary DiCesare (@zdicesare)
It is no longer necessary to specify the binary name when passing flags to containers. For example, to execute the
help
command of the collector, instead of$ docker run -it --rm jaegertracing/jaeger-collector /go/bin/collector-linux help
run
$ docker run -it --rm jaegertracing/jaeger-collector help
-
Detect HTTP payload format from Content-Type (#916) by Yuri Shkuro (@yurishkuro)
When submitting spans in Thrift format to HTTP endpoint
/api/traces
, theformat
argument is no longer required, but the Content-Type header must be set to "application/vnd.apache.thrift.binary". -
Change metric tag from "service" to "svc" (#883) by Won Jun Jang (@black-adder)
-
Add Kafka as a Storage Plugin (#862) by David Yeghshatyan (@davit-y)
The collectors can be configured to write spans to Kafka for further data mining.
-
Package static assets inside the query-service binary (#918) by Yuri Shkuro (@yurishkuro)
It is no longer necessary (but still possible) to pass the path to UI static assets to jaeger-query and jaeger-standalone binaries.
-
Replace domain model with Protobuf/gogo-generated model (#856) by Yuri Shkuro (@yurishkuro)
First step towards switching to Protobuf and gRPC.
-
Include HotROD binary in the distributions (#917) by Yuri Shkuro (@yurishkuro)
-
Improve HotROD demo (#915) by Yuri Shkuro (@yurishkuro)
-
Add DisableAutoDiscovery param to cassandra config (#912) by Bill Westlin (@whistlinwilly)
-
Add connCheckTimeout flag to agent (#911) by Henrique Rodrigues (@Henrod)
-
Ability to use multiple storage types (#880) by David Yeghshatyan (@davit-y)
- [ES storage] Log number of total and failed requests (#902) by Tomasz Adamski (@tmszdmsk)
- [ES storage] Do not log requests on error (#901) by Tomasz Adamski (@tmszdmsk)
- [ES storage] Do not exceed ES _id length limit (#905) by Łukasz Harasimowicz (@harnash) and Tomasz Adamski (@tmszdmsk)
- Add cassandra index filter (#876) by Won Jun Jang (@black-adder)
- Close span writer in standalone (#863) (4 weeks ago) by Pavol Loffay (@pavolloffay)
- Log configuration options for memory storage (#852) (6 weeks ago) by Juraci Paixão Kröhling (@jpkrohling)
- Update collector metric counters to have a name (#886) by Won Jun Jang (@black-adder)
- Add CONTRIBUTING_GUIDELINES.md (#864) by (@PikBot)
- Add bounds to memory storage (#845) by Juraci Paixão Kröhling (@jpkrohling)
- Add metric for debug traces (#796) by Won Jun Jang (@black-adder)
- Change metrics naming scheme (#776) by Juraci Paixão Kröhling (@jpkrohling)
- Remove ParentSpanID from domain model (#831) by Yuri Shkuro (@yurishkuro)
- Add ability to adjust static sampling probabilities per operation (#827) by Won Jun Jang (@black-adder)
- Support log-level flag on agent (#828) by Won Jun Jang (@black-adder)
- Add healthcheck to standalone (#784) by Eundoo Song (@eundoosong)
- Do not use KeyValue fields directly and use KeyValues as decorator only (#810) by Yuri Shkuro (@yurishkuro)
- Upgrade to go 1.10 (#792) by Prithvi Raj (@vprithvi)
- Do not create Cassandra index if it already exists (#782) by Greg Swift (@gregswift)
- None
- Publish binaries for Linux, Darwin, and Windows (#765) - thanks to @grounded042
- View Trace JSON buttons return formatted JSON (fixes #199)
- Support traces with >10k spans in Elasticsearch (#668) - thanks to @sramakr
- Allow slash '/' in service names (#586)
- Log errors from HotROD services (#769)
- Add sampling handler with file-based configuration for agents to query (#720) (#674)
- Allow overriding base path for UI/API routes and remove --query.prefix (#748)
- Add Dockerfile for hotrod example app (#694) <Guilherme Baufaker Rêgo>
- Publish hotrod image to docker hub (#702)
- Dockerize es-index-cleaner script (#741)
- Add a flag to control Cassandra consistency level (#700)
- Collect metrics from ES bulk service (#688)
- Allow zero replicas for Elasticsearch (#754)
- Apply namespace when creating Prometheus metrics factory (fix for #732) (#733)
- Disable double compression on Prom Handler - fixes #697 (#735) <Juraci Paixão Kröhling>
- Use the default metricsFactory if not provided (#739)
- Avoid duplicate expvar metrics - fixes #716 (#726)
- Make sure different tracers in HotROD process use different random generator seeds (#718)
- Test that processes with identical tags are deduped (#708)
- When converting microseconds to time.Time ensure UTC timezone (#712)
- Add to WaitGroup before the goroutine creation (#711)
- Pin testify version to ^1.2.1 (#710)
- Support running Jaeger behind a reverse proxy (fixes #42)
- Track Javascript errors via Google Analytics (fixes #39)
- Add Google Analytics event tracking for actions in trace view (#191)
- Clearly identify traces without a root span (fixes #190)
- Fix #166 JS error on search page after viewing 404 trace
- Use elasticsearch bulk API (#656)
- Support archive storage in the query-service (#604)
- Introduce storage factory framework and composable CLI (#625)
- Make agent host port configurable in hotrod (#663)
- Add signal handling to standalone (#657)
- Remove the override of GOMAXPROCS (#679)
- Use UTC timezone for ES indices (#646)
- Fix elasticsearch create index race condition error (#641)
- Use Ant Design instead of Semantic UI (jaegertracing/jaeger-ui#169)
- Fix 2 digit lookback (12h, 24h) parsing (jaegertracing/jaeger-ui#167)
- Add support for retrieving unadjusted/raw traces (#615)
- Add CA certificates to collector/query images (#485)
- Parse zipkin v2 high trace id (#596)
- Skip nil and zero length hits in ElasticSearch storage (#601)
- Make Cassandra service_name_index inserts idempotent (#587)
- Align atomic int64 to word boundary to fix SIGSEGV (#592)
- Add adjuster that removes bad span references (#614)
- Set operationNames cache initial capacity to 10000 (#621)
- Change tag search input syntax to logfmt (jaegertracing/jaeger-ui#145)
- Make threshold for enabling DAG view configurable (jaegertracing/jaeger-ui#130)
- Show better error messages for failed API calls (jaegertracing/jaeger-ui#127)
- Add View Option for raw/unadjusted trace (jaegertracing/jaeger-ui#153)
- Add timezone tooltip to custom lookback form-field (jaegertracing/jaeger-ui#161)
- Use consistent icons for logs expanded/collapsed (jaegertracing/jaeger-ui#86)
- Encode service name in API calls to allow '/' (jaegertracing/jaeger-ui#138)
- Fix endless trace HTTP requests (jaegertracing/jaeger-ui#128)
- Fix JSON view when running in dev mode (jaegertracing/jaeger-ui#139)
- Fix trace name resolution (jaegertracing/jaeger-ui#134)
- Only JSON.parse JSON strings in tags/logs values (jaegertracing/jaeger-ui#162)
- Support Prometheus metrics as default for all components (#516)
- Enable TLS client connections to Cassandra (#555)
- Fix issue where Domain to UI model converter double reports references (#579)
- Make dependencies tab configurable (#122)
- Verify stored search settings jaegertracing/jaeger-ui#111
- Fix browser back button not working correctly jaegertracing/jaeger-ui#110
- Handle FOLLOWS_FROM ref type jaegertracing/jaeger-ui#118
- Allow embedding custom UI config in index.html #490
- Add startTimeMillis field to JSON Spans submitted to ElasticSearch #491
- Introduce version command and handler #517
- Fix ElasticSearch aggregation errors when index is empty #535
- Change package from uber to jaegertracing #528
- Introduce logging level configuration #514
- Support Zipkin v2 json #518
- Add HTTP compression handler #545
- Refactor trace detail jaegertracing/jaeger-ui#53
- Virtualized scrolling for trace detail view jaegertracing/jaeger-ui#68
- Mouseover expands truncated text to full length in left column in trace view jaegertracing/jaeger-ui#71
- Make left column adjustable in trace detail view jaegertracing/jaeger-ui#74
- Fix trace mini-map blurriness when < 60 spans jaegertracing/jaeger-ui#77
- Fix Google Analytics tracking jaegertracing/jaeger-ui#81
- Improve search dropdowns jaegertracing/jaeger-ui#84
- Add keyboard shortcuts and minimap UX jaegertracing/jaeger-ui#93
- Add tracing to the query server #454
- Support configuration files #462
- Add cassandra tag filter #442
- Handle ports > 32k in Zipkin JSON #488
- Convert to Apache 2.0 License