blob: 6c88db5317234199be6cbc2a7cdcb8535deb663f [file] [log] [blame]
[email protected]f90bf0d92011-01-13 02:12:441// Copyright (c) 2011 The Chromium Authors. All rights reserved.
license.botbf09a502008-08-24 00:55:552// Use of this source code is governed by a BSD-style license that can be
3// found in the LICENSE file.
initial.commit09911bf2008-07-26 23:55:294
initial.commit09911bf2008-07-26 23:55:295//------------------------------------------------------------------------------
6// Description of the life cycle of a instance of MetricsService.
7//
8// OVERVIEW
9//
10// A MetricsService instance is typically created at application startup. It
11// is the central controller for the acquisition of log data, and the automatic
12// transmission of that log data to an external server. Its major job is to
13// manage logs, grouping them for transmission, and transmitting them. As part
14// of its grouping, MS finalizes logs by including some just-in-time gathered
15// memory statistics, snapshotting the current stats of numerous histograms,
16// closing the logs, translating to XML text, and compressing the results for
17// transmission. Transmission includes submitting a compressed log as data in a
[email protected]281d2882009-01-20 20:32:4218// URL-post, and retransmitting (or retaining at process termination) if the
initial.commit09911bf2008-07-26 23:55:2919// attempted transmission failed. Retention across process terminations is done
[email protected]46f89e142010-07-19 08:00:4220// using the the PrefServices facilities. The retained logs (the ones that never
21// got transmitted) are compressed and base64-encoded before being persisted.
initial.commit09911bf2008-07-26 23:55:2922//
[email protected]281d2882009-01-20 20:32:4223// Logs fall into one of two categories: "initial logs," and "ongoing logs."
24// There is at most one initial log sent for each complete run of the chromium
initial.commit09911bf2008-07-26 23:55:2925// product (from startup, to browser shutdown). An initial log is generally
26// transmitted some short time (1 minute?) after startup, and includes stats
27// such as recent crash info, the number and types of plugins, etc. The
[email protected]281d2882009-01-20 20:32:4228// external server's response to the initial log conceptually tells this MS if
29// it should continue transmitting logs (during this session). The server
30// response can actually be much more detailed, and always includes (at a
31// minimum) how often additional ongoing logs should be sent.
initial.commit09911bf2008-07-26 23:55:2932//
33// After the above initial log, a series of ongoing logs will be transmitted.
34// The first ongoing log actually begins to accumulate information stating when
35// the MS was first constructed. Note that even though the initial log is
36// commonly sent a full minute after startup, the initial log does not include
37// much in the way of user stats. The most common interlog period (delay)
[email protected]0b33f80b2008-12-17 21:34:3638// is 20 minutes. That time period starts when the first user action causes a
initial.commit09911bf2008-07-26 23:55:2939// logging event. This means that if there is no user action, there may be long
[email protected]281d2882009-01-20 20:32:4240// periods without any (ongoing) log transmissions. Ongoing logs typically
initial.commit09911bf2008-07-26 23:55:2941// contain very detailed records of user activities (ex: opened tab, closed
42// tab, fetched URL, maximized window, etc.) In addition, just before an
43// ongoing log is closed out, a call is made to gather memory statistics. Those
44// memory statistics are deposited into a histogram, and the log finalization
45// code is then called. In the finalization, a call to a Histogram server
46// acquires a list of all local histograms that have been flagged for upload
[email protected]281d2882009-01-20 20:32:4247// to the UMA server. The finalization also acquires a the most recent number
48// of page loads, along with any counts of renderer or plugin crashes.
initial.commit09911bf2008-07-26 23:55:2949//
50// When the browser shuts down, there will typically be a fragment of an ongoing
51// log that has not yet been transmitted. At shutdown time, that fragment
[email protected]cac267c2011-09-29 15:18:1052// is closed (including snapshotting histograms), and persisted, for
initial.commit09911bf2008-07-26 23:55:2953// potential transmission during a future run of the product.
54//
55// There are two slightly abnormal shutdown conditions. There is a
56// "disconnected scenario," and a "really fast startup and shutdown" scenario.
57// In the "never connected" situation, the user has (during the running of the
58// process) never established an internet connection. As a result, attempts to
59// transmit the initial log have failed, and a lot(?) of data has accumulated in
60// the ongoing log (which didn't yet get closed, because there was never even a
61// contemplation of sending it). There is also a kindred "lost connection"
62// situation, where a loss of connection prevented an ongoing log from being
63// transmitted, and a (still open) log was stuck accumulating a lot(?) of data,
64// while the earlier log retried its transmission. In both of these
65// disconnected situations, two logs need to be, and are, persistently stored
66// for future transmission.
67//
68// The other unusual shutdown condition, termed "really fast startup and
69// shutdown," involves the deliberate user termination of the process before
70// the initial log is even formed or transmitted. In that situation, no logging
71// is done, but the historical crash statistics remain (unlogged) for inclusion
72// in a future run's initial log. (i.e., we don't lose crash stats).
73//
74// With the above overview, we can now describe the state machine's various
75// stats, based on the State enum specified in the state_ member. Those states
76// are:
77//
78// INITIALIZED, // Constructor was called.
[email protected]85ed9d42010-06-08 22:37:4479// INIT_TASK_SCHEDULED, // Waiting for deferred init tasks to complete.
80// INIT_TASK_DONE, // Waiting for timer to send initial log.
initial.commit09911bf2008-07-26 23:55:2981// INITIAL_LOG_READY, // Initial log generated, and waiting for reply.
initial.commit09911bf2008-07-26 23:55:2982// SENDING_OLD_LOGS, // Sending unsent logs from previous session.
83// SENDING_CURRENT_LOGS, // Sending standard current logs as they accrue.
84//
85// In more detail, we have:
86//
87// INITIALIZED, // Constructor was called.
88// The MS has been constructed, but has taken no actions to compose the
89// initial log.
90//
[email protected]85ed9d42010-06-08 22:37:4491// INIT_TASK_SCHEDULED, // Waiting for deferred init tasks to complete.
initial.commit09911bf2008-07-26 23:55:2992// Typically about 30 seconds after startup, a task is sent to a second thread
[email protected]85ed9d42010-06-08 22:37:4493// (the file thread) to perform deferred (lower priority and slower)
94// initialization steps such as getting the list of plugins. That task will
95// (when complete) make an async callback (via a Task) to indicate the
96// completion.
initial.commit09911bf2008-07-26 23:55:2997//
[email protected]85ed9d42010-06-08 22:37:4498// INIT_TASK_DONE, // Waiting for timer to send initial log.
initial.commit09911bf2008-07-26 23:55:2999// The callback has arrived, and it is now possible for an initial log to be
100// created. This callback typically arrives back less than one second after
[email protected]85ed9d42010-06-08 22:37:44101// the deferred init task is dispatched.
initial.commit09911bf2008-07-26 23:55:29102//
103// INITIAL_LOG_READY, // Initial log generated, and waiting for reply.
104// This state is entered only after an initial log has been composed, and
105// prepared for transmission. It is also the case that any previously unsent
106// logs have been loaded into instance variables for possible transmission.
107//
initial.commit09911bf2008-07-26 23:55:29108// SENDING_OLD_LOGS, // Sending unsent logs from previous session.
[email protected]cac267c2011-09-29 15:18:10109// This state indicates that the initial log for this session has been
110// successfully sent and it is now time to send any logs that were
111// saved from previous sessions. All such logs will be transmitted before
112// exiting this state, and proceeding with ongoing logs from the current session
113// (see next state).
initial.commit09911bf2008-07-26 23:55:29114//
115// SENDING_CURRENT_LOGS, // Sending standard current logs as they accrue.
[email protected]0b33f80b2008-12-17 21:34:36116// Current logs are being accumulated. Typically every 20 minutes a log is
initial.commit09911bf2008-07-26 23:55:29117// closed and finalized for transmission, at the same time as a new log is
118// started.
119//
120// The progression through the above states is simple, and sequential, in the
121// most common use cases. States proceed from INITIAL to SENDING_CURRENT_LOGS,
122// and remain in the latter until shutdown.
123//
124// The one unusual case is when the user asks that we stop logging. When that
[email protected]cac267c2011-09-29 15:18:10125// happens, any staged (transmission in progress) log is persisted, and any log
126// log that is currently accumulating is also finalized and persisted. We then
127// regress back to the SEND_OLD_LOGS state in case the user enables log
128// recording again during this session. This way anything we have persisted
129// will be sent automatically if/when we progress back to SENDING_CURRENT_LOG
130// state.
initial.commit09911bf2008-07-26 23:55:29131//
[email protected]cac267c2011-09-29 15:18:10132// Also note that whenever we successfully send an old log, we mirror the list
133// of logs into the PrefService. This ensures that IF we crash, we won't start
134// up and retransmit our old logs again.
initial.commit09911bf2008-07-26 23:55:29135//
136// Due to race conditions, it is always possible that a log file could be sent
137// twice. For example, if a log file is sent, but not yet acknowledged by
138// the external server, and the user shuts down, then a copy of the log may be
139// saved for re-transmission. These duplicates could be filtered out server
[email protected]281d2882009-01-20 20:32:42140// side, but are not expected to be a significant problem.
initial.commit09911bf2008-07-26 23:55:29141//
142//
143//------------------------------------------------------------------------------
144
[email protected]40bcc302009-03-02 20:50:39145#include "chrome/browser/metrics/metrics_service.h"
146
[email protected]7f7f1962011-04-20 15:58:16147#include "base/bind.h"
148#include "base/callback.h"
[email protected]5d91c9e2010-07-28 17:25:28149#include "base/command_line.h"
[email protected]46f89e142010-07-19 08:00:42150#include "base/md5.h"
[email protected]835d7c82010-10-14 04:38:38151#include "base/metrics/histogram.h"
[email protected]528c56d2010-07-30 19:28:44152#include "base/string_number_conversions.h"
[email protected]ce072a72010-12-31 20:02:16153#include "base/threading/platform_thread.h"
[email protected]b3841c502011-03-09 01:21:31154#include "base/threading/thread.h"
[email protected]440b37b22010-08-30 05:31:40155#include "base/utf_string_conversions.h"
[email protected]679082052010-07-21 21:30:13156#include "base/values.h"
[email protected]d8e41ed2008-09-11 15:22:32157#include "chrome/browser/bookmarks/bookmark_model.h"
initial.commit09911bf2008-07-26 23:55:29158#include "chrome/browser/browser_process.h"
[email protected]718eab62011-10-05 21:16:52159#include "chrome/browser/extensions/extension_process_manager.h"
[email protected]84c988a2011-04-19 17:56:33160#include "chrome/browser/memory_details.h"
[email protected]7c927b62010-02-24 09:54:13161#include "chrome/browser/metrics/histogram_synchronizer.h"
[email protected]679082052010-07-21 21:30:13162#include "chrome/browser/metrics/metrics_log.h"
[email protected]cac267c2011-09-29 15:18:10163#include "chrome/browser/metrics/metrics_log_serializer.h"
[email protected]7f7f1962011-04-20 15:58:16164#include "chrome/browser/metrics/metrics_reporting_scheduler.h"
[email protected]d67d1052011-06-09 05:11:41165#include "chrome/browser/net/network_stats.h"
[email protected]37858e52010-08-26 00:22:02166#include "chrome/browser/prefs/pref_service.h"
[email protected]f8628c22011-04-05 12:10:18167#include "chrome/browser/prefs/scoped_user_pref_update.h"
[email protected]8ecad5e2010-12-02 21:18:33168#include "chrome/browser/profiles/profile.h"
[email protected]8e5c89a2011-06-07 18:13:33169#include "chrome/browser/search_engines/template_url_service.h"
[email protected]71b73f02011-04-06 15:57:29170#include "chrome/browser/ui/browser_list.h"
[email protected]157d5472009-11-05 22:31:03171#include "chrome/common/child_process_logging.h"
[email protected]432115822011-07-10 15:52:27172#include "chrome/common/chrome_notification_types.h"
[email protected]92745242009-06-12 16:52:21173#include "chrome/common/chrome_switches.h"
[email protected]3eb0d8f72010-12-15 23:38:25174#include "chrome/common/guid.h"
[email protected]cac267c2011-09-29 15:18:10175#include "chrome/common/metrics_log_manager.h"
initial.commit09911bf2008-07-26 23:55:29176#include "chrome/common/pref_names.h"
[email protected]e09ba552009-02-05 03:26:29177#include "chrome/common/render_messages.h"
[email protected]35e251d2011-05-24 21:01:04178#include "content/browser/load_notification_details.h"
[email protected]d33e7cc2011-09-23 01:43:56179#include "content/browser/plugin_service.h"
[email protected]5de634712011-03-02 00:20:19180#include "content/browser/renderer_host/render_process_host.h"
[email protected]6faf7b12011-03-09 19:24:14181#include "content/common/child_process_info.h"
[email protected]ad50def52011-10-19 23:17:07182#include "content/public/browser/notification_service.h"
[email protected]191eb3f72010-12-21 06:27:50183#include "webkit/plugins/npapi/plugin_list.h"
[email protected]91d9f3d2011-08-14 05:24:44184#include "webkit/plugins/webplugininfo.h"
initial.commit09911bf2008-07-26 23:55:29185
[email protected]e06131d2010-02-10 18:40:33186// TODO(port): port browser_distribution.h.
187#if !defined(OS_POSIX)
[email protected]79bf0b72009-04-27 21:30:55188#include "chrome/installer/util/browser_distribution.h"
[email protected]dc6f4962009-02-13 01:25:50189#endif
190
[email protected]5ccaa412009-11-13 22:00:16191#if defined(OS_CHROMEOS)
[email protected]db342d52010-08-09 21:19:37192#include "chrome/browser/chromeos/cros/cros_library.h"
[email protected]5ccaa412009-11-13 22:00:16193#include "chrome/browser/chromeos/external_metrics.h"
[email protected]d43970a72011-07-10 06:24:52194#include "chrome/browser/chromeos/system/statistics_provider.h"
[email protected]5ccaa412009-11-13 22:00:16195#endif
196
[email protected]e1acf6f2008-10-27 20:43:33197using base::Time;
[email protected]e1acf6f2008-10-27 20:43:33198
initial.commit09911bf2008-07-26 23:55:29199// Check to see that we're being called on only one thread.
200static bool IsSingleThreaded();
201
initial.commit09911bf2008-07-26 23:55:29202static const char kMetricsType[] = "application/vnd.mozilla.metrics.bz2";
203
[email protected]7f7f1962011-04-20 15:58:16204// The delay, in seconds, after starting recording before doing expensive
205// initialization work.
206static const int kInitializationDelaySeconds = 30;
[email protected]252873ef2008-08-04 21:59:45207
[email protected]c9a3ef82009-05-28 22:02:46208// This specifies the amount of time to wait for all renderers to send their
209// data.
210static const int kMaxHistogramGatheringWaitDuration = 60000; // 60 seconds.
211
[email protected]54702c92011-04-15 15:06:43212// The maximum number of events in a log uploaded to the UMA server.
[email protected]7d770852011-09-20 23:56:58213static const int kEventLimit = 2400;
[email protected]68475e602008-08-22 03:21:15214
215// If an upload fails, and the transmission was over this byte count, then we
216// will discard the log, and not try to retransmit it. We also don't persist
217// the log to the prefs for transmission during the next chrome session if this
218// limit is exceeded.
219static const int kUploadLogAvoidRetransmitSize = 50000;
initial.commit09911bf2008-07-26 23:55:29220
initial.commit09911bf2008-07-26 23:55:29221// Interval, in seconds, between state saves.
222static const int kSaveStateInterval = 5 * 60; // five minutes
223
[email protected]c0c55e92011-09-10 18:47:30224// static
225MetricsService::ShutdownCleanliness MetricsService::clean_shutdown_status_ =
226 MetricsService::CLEANLY_SHUTDOWN;
227
[email protected]679082052010-07-21 21:30:13228// This is used to quickly log stats from child process related notifications in
229// MetricsService::child_stats_buffer_. The buffer's contents are transferred
230// out when Local State is periodically saved. The information is then
231// reported to the UMA server on next launch.
232struct MetricsService::ChildProcessStats {
233 public:
234 explicit ChildProcessStats(ChildProcessInfo::ProcessType type)
235 : process_launches(0),
236 process_crashes(0),
237 instances(0),
238 process_type(type) {}
239
240 // This constructor is only used by the map to return some default value for
241 // an index for which no value has been assigned.
242 ChildProcessStats()
243 : process_launches(0),
[email protected]d88bf0a2011-08-30 23:55:57244 process_crashes(0),
245 instances(0),
246 process_type(ChildProcessInfo::UNKNOWN_PROCESS) {}
[email protected]679082052010-07-21 21:30:13247
248 // The number of times that the given child process has been launched
249 int process_launches;
250
251 // The number of times that the given child process has crashed
252 int process_crashes;
253
254 // The number of instances of this child process that have been created.
255 // An instance is a DOM object rendered by this child process during a page
256 // load.
257 int instances;
258
259 ChildProcessInfo::ProcessType process_type;
260};
initial.commit09911bf2008-07-26 23:55:29261
[email protected]84c988a2011-04-19 17:56:33262// Handles asynchronous fetching of memory details.
263// Will run the provided task after finished.
264class MetricsMemoryDetails : public MemoryDetails {
265 public:
266 explicit MetricsMemoryDetails(Task* completion) : completion_(completion) {}
267
268 virtual void OnDetailsAvailable() {
269 MessageLoop::current()->PostTask(FROM_HERE, completion_);
270 }
271
272 private:
273 ~MetricsMemoryDetails() {}
274
275 Task* completion_;
276 DISALLOW_COPY_AND_ASSIGN(MetricsMemoryDetails);
277};
278
initial.commit09911bf2008-07-26 23:55:29279// static
280void MetricsService::RegisterPrefs(PrefService* local_state) {
281 DCHECK(IsSingleThreaded());
[email protected]20ce516d2010-06-18 02:20:04282 local_state->RegisterStringPref(prefs::kMetricsClientID, "");
[email protected]0bb1a622009-03-04 03:22:32283 local_state->RegisterInt64Pref(prefs::kMetricsClientIDTimestamp, 0);
284 local_state->RegisterInt64Pref(prefs::kStabilityLaunchTimeSec, 0);
285 local_state->RegisterInt64Pref(prefs::kStabilityLastTimestampSec, 0);
[email protected]20ce516d2010-06-18 02:20:04286 local_state->RegisterStringPref(prefs::kStabilityStatsVersion, "");
[email protected]225c50842010-01-19 21:19:13287 local_state->RegisterInt64Pref(prefs::kStabilityStatsBuildTime, 0);
initial.commit09911bf2008-07-26 23:55:29288 local_state->RegisterBooleanPref(prefs::kStabilityExitedCleanly, true);
289 local_state->RegisterBooleanPref(prefs::kStabilitySessionEndCompleted, true);
290 local_state->RegisterIntegerPref(prefs::kMetricsSessionID, -1);
291 local_state->RegisterIntegerPref(prefs::kStabilityLaunchCount, 0);
292 local_state->RegisterIntegerPref(prefs::kStabilityCrashCount, 0);
293 local_state->RegisterIntegerPref(prefs::kStabilityIncompleteSessionEndCount,
294 0);
295 local_state->RegisterIntegerPref(prefs::kStabilityPageLoadCount, 0);
initial.commit09911bf2008-07-26 23:55:29296 local_state->RegisterIntegerPref(prefs::kStabilityRendererCrashCount, 0);
[email protected]1f085622009-12-04 05:33:45297 local_state->RegisterIntegerPref(prefs::kStabilityExtensionRendererCrashCount,
298 0);
initial.commit09911bf2008-07-26 23:55:29299 local_state->RegisterIntegerPref(prefs::kStabilityRendererHangCount, 0);
[email protected]1f085622009-12-04 05:33:45300 local_state->RegisterIntegerPref(prefs::kStabilityChildProcessCrashCount, 0);
[email protected]e73c01972008-08-13 00:18:24301 local_state->RegisterIntegerPref(prefs::kStabilityBreakpadRegistrationFail,
302 0);
303 local_state->RegisterIntegerPref(prefs::kStabilityBreakpadRegistrationSuccess,
304 0);
305 local_state->RegisterIntegerPref(prefs::kStabilityDebuggerPresent, 0);
306 local_state->RegisterIntegerPref(prefs::kStabilityDebuggerNotPresent, 0);
[email protected]c1834a92011-01-21 18:21:03307#if defined(OS_CHROMEOS)
308 local_state->RegisterIntegerPref(prefs::kStabilityOtherUserCrashCount, 0);
309 local_state->RegisterIntegerPref(prefs::kStabilityKernelCrashCount, 0);
310 local_state->RegisterIntegerPref(prefs::kStabilitySystemUncleanShutdownCount,
311 0);
312#endif // OS_CHROMEOS
[email protected]e73c01972008-08-13 00:18:24313
initial.commit09911bf2008-07-26 23:55:29314 local_state->RegisterDictionaryPref(prefs::kProfileMetrics);
315 local_state->RegisterIntegerPref(prefs::kNumBookmarksOnBookmarkBar, 0);
316 local_state->RegisterIntegerPref(prefs::kNumFoldersOnBookmarkBar, 0);
317 local_state->RegisterIntegerPref(prefs::kNumBookmarksInOtherBookmarkFolder,
318 0);
319 local_state->RegisterIntegerPref(prefs::kNumFoldersInOtherBookmarkFolder, 0);
320 local_state->RegisterIntegerPref(prefs::kNumKeywords, 0);
321 local_state->RegisterListPref(prefs::kMetricsInitialLogs);
322 local_state->RegisterListPref(prefs::kMetricsOngoingLogs);
[email protected]0bb1a622009-03-04 03:22:32323
324 local_state->RegisterInt64Pref(prefs::kUninstallMetricsPageLoadCount, 0);
325 local_state->RegisterInt64Pref(prefs::kUninstallLaunchCount, 0);
[email protected]6b5f21d2009-04-13 17:01:35326 local_state->RegisterInt64Pref(prefs::kUninstallMetricsInstallDate, 0);
[email protected]0bb1a622009-03-04 03:22:32327 local_state->RegisterInt64Pref(prefs::kUninstallMetricsUptimeSec, 0);
328 local_state->RegisterInt64Pref(prefs::kUninstallLastLaunchTimeSec, 0);
329 local_state->RegisterInt64Pref(prefs::kUninstallLastObservedRunTimeSec, 0);
initial.commit09911bf2008-07-26 23:55:29330}
331
[email protected]541f77922009-02-23 21:14:38332// static
333void MetricsService::DiscardOldStabilityStats(PrefService* local_state) {
334 local_state->SetBoolean(prefs::kStabilityExitedCleanly, true);
[email protected]c9abf242009-07-18 06:00:38335 local_state->SetBoolean(prefs::kStabilitySessionEndCompleted, true);
[email protected]541f77922009-02-23 21:14:38336
337 local_state->SetInteger(prefs::kStabilityIncompleteSessionEndCount, 0);
338 local_state->SetInteger(prefs::kStabilityBreakpadRegistrationSuccess, 0);
339 local_state->SetInteger(prefs::kStabilityBreakpadRegistrationFail, 0);
340 local_state->SetInteger(prefs::kStabilityDebuggerPresent, 0);
341 local_state->SetInteger(prefs::kStabilityDebuggerNotPresent, 0);
342
343 local_state->SetInteger(prefs::kStabilityLaunchCount, 0);
344 local_state->SetInteger(prefs::kStabilityCrashCount, 0);
345
346 local_state->SetInteger(prefs::kStabilityPageLoadCount, 0);
347 local_state->SetInteger(prefs::kStabilityRendererCrashCount, 0);
348 local_state->SetInteger(prefs::kStabilityRendererHangCount, 0);
349
[email protected]9165f742010-03-10 22:55:01350 local_state->SetInt64(prefs::kStabilityLaunchTimeSec, 0);
351 local_state->SetInt64(prefs::kStabilityLastTimestampSec, 0);
[email protected]541f77922009-02-23 21:14:38352
353 local_state->ClearPref(prefs::kStabilityPluginStats);
[email protected]ae155cb92009-06-19 06:10:37354
[email protected]f8628c22011-04-05 12:10:18355 local_state->ClearPref(prefs::kMetricsInitialLogs);
356 local_state->ClearPref(prefs::kMetricsOngoingLogs);
[email protected]541f77922009-02-23 21:14:38357}
358
initial.commit09911bf2008-07-26 23:55:29359MetricsService::MetricsService()
[email protected]d01b8732008-10-16 02:18:07360 : recording_active_(false),
361 reporting_active_(false),
[email protected]d01b8732008-10-16 02:18:07362 state_(INITIALIZED),
initial.commit09911bf2008-07-26 23:55:29363 current_fetch_(NULL),
[email protected]d67d1052011-06-09 05:11:41364 io_thread_(NULL),
[email protected]d01b8732008-10-16 02:18:07365 idle_since_last_transmission_(false),
initial.commit09911bf2008-07-26 23:55:29366 next_window_id_(0),
[email protected]40bcc302009-03-02 20:50:39367 ALLOW_THIS_IN_INITIALIZER_LIST(log_sender_factory_(this)),
368 ALLOW_THIS_IN_INITIALIZER_LIST(state_saver_factory_(this)),
[email protected]7f7f1962011-04-20 15:58:16369 waiting_for_asynchronus_reporting_step_(false) {
initial.commit09911bf2008-07-26 23:55:29370 DCHECK(IsSingleThreaded());
371 InitializeMetricsState();
[email protected]7f7f1962011-04-20 15:58:16372
373 base::Closure callback = base::Bind(&MetricsService::StartScheduledUpload,
374 base::Unretained(this));
375 scheduler_.reset(new MetricsReportingScheduler(callback));
[email protected]cac267c2011-09-29 15:18:10376 log_manager_.set_log_serializer(new MetricsLogSerializer());
377 log_manager_.set_max_ongoing_log_store_size(kUploadLogAvoidRetransmitSize);
initial.commit09911bf2008-07-26 23:55:29378}
379
380MetricsService::~MetricsService() {
381 SetRecording(false);
382}
383
[email protected]d01b8732008-10-16 02:18:07384void MetricsService::Start() {
[email protected]b1c8dc02011-04-13 18:32:04385 HandleIdleSinceLastTransmission(false);
[email protected]d01b8732008-10-16 02:18:07386 SetRecording(true);
387 SetReporting(true);
388}
389
390void MetricsService::StartRecordingOnly() {
391 SetRecording(true);
392 SetReporting(false);
393}
394
395void MetricsService::Stop() {
[email protected]b1c8dc02011-04-13 18:32:04396 HandleIdleSinceLastTransmission(false);
[email protected]d01b8732008-10-16 02:18:07397 SetReporting(false);
398 SetRecording(false);
399}
400
[email protected]edafd4c2011-05-10 17:18:53401std::string MetricsService::GetClientId() {
402 return client_id_;
403}
404
initial.commit09911bf2008-07-26 23:55:29405void MetricsService::SetRecording(bool enabled) {
406 DCHECK(IsSingleThreaded());
407
[email protected]d01b8732008-10-16 02:18:07408 if (enabled == recording_active_)
initial.commit09911bf2008-07-26 23:55:29409 return;
410
411 if (enabled) {
[email protected]b0c819f2009-03-08 04:52:15412 if (client_id_.empty()) {
413 PrefService* pref = g_browser_process->local_state();
414 DCHECK(pref);
[email protected]ddd231e2010-06-29 20:35:19415 client_id_ = pref->GetString(prefs::kMetricsClientID);
[email protected]b0c819f2009-03-08 04:52:15416 if (client_id_.empty()) {
417 client_id_ = GenerateClientID();
[email protected]ddd231e2010-06-29 20:35:19418 pref->SetString(prefs::kMetricsClientID, client_id_);
[email protected]b0c819f2009-03-08 04:52:15419
420 // Might as well make a note of how long this ID has existed
421 pref->SetString(prefs::kMetricsClientIDTimestamp,
[email protected]528c56d2010-07-30 19:28:44422 base::Int64ToString(Time::Now().ToTimeT()));
[email protected]b0c819f2009-03-08 04:52:15423 }
424 }
[email protected]157d5472009-11-05 22:31:03425 child_process_logging::SetClientId(client_id_);
initial.commit09911bf2008-07-26 23:55:29426 StartRecording();
[email protected]005ef3e2009-05-22 20:55:46427
[email protected]3ffd3ae2011-03-17 22:17:52428 SetUpNotifications(&registrar_, this);
initial.commit09911bf2008-07-26 23:55:29429 } else {
[email protected]005ef3e2009-05-22 20:55:46430 registrar_.RemoveAll();
[email protected]cac267c2011-09-29 15:18:10431 PushPendingLogsToPersistentStorage();
432 DCHECK(!log_manager_.has_staged_log());
433 if (state_ > INITIAL_LOG_READY && log_manager_.has_unsent_logs())
434 state_ = SENDING_OLD_LOGS;
initial.commit09911bf2008-07-26 23:55:29435 }
[email protected]d01b8732008-10-16 02:18:07436 recording_active_ = enabled;
initial.commit09911bf2008-07-26 23:55:29437}
438
[email protected]d01b8732008-10-16 02:18:07439bool MetricsService::recording_active() const {
initial.commit09911bf2008-07-26 23:55:29440 DCHECK(IsSingleThreaded());
[email protected]d01b8732008-10-16 02:18:07441 return recording_active_;
initial.commit09911bf2008-07-26 23:55:29442}
443
[email protected]d01b8732008-10-16 02:18:07444void MetricsService::SetReporting(bool enable) {
445 if (reporting_active_ != enable) {
446 reporting_active_ = enable;
447 if (reporting_active_)
[email protected]7f7f1962011-04-20 15:58:16448 StartSchedulerIfNecessary();
initial.commit09911bf2008-07-26 23:55:29449 }
[email protected]d01b8732008-10-16 02:18:07450}
451
452bool MetricsService::reporting_active() const {
453 DCHECK(IsSingleThreaded());
454 return reporting_active_;
initial.commit09911bf2008-07-26 23:55:29455}
456
[email protected]87ef9ea2011-02-26 03:15:15457// static
[email protected]6c2381d2011-10-19 02:52:53458void MetricsService::SetUpNotifications(
459 content::NotificationRegistrar* registrar,
460 content::NotificationObserver* observer) {
461 registrar->Add(observer, chrome::NOTIFICATION_BROWSER_OPENED,
[email protected]ad50def52011-10-19 23:17:07462 content::NotificationService::AllBrowserContextsAndSources());
[email protected]6c2381d2011-10-19 02:52:53463 registrar->Add(observer, chrome::NOTIFICATION_BROWSER_CLOSED,
[email protected]ad50def52011-10-19 23:17:07464 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53465 registrar->Add(observer, content::NOTIFICATION_USER_ACTION,
[email protected]ad50def52011-10-19 23:17:07466 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53467 registrar->Add(observer, content::NOTIFICATION_TAB_PARENTED,
[email protected]ad50def52011-10-19 23:17:07468 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53469 registrar->Add(observer, content::NOTIFICATION_TAB_CLOSING,
[email protected]ad50def52011-10-19 23:17:07470 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53471 registrar->Add(observer, content::NOTIFICATION_LOAD_START,
[email protected]ad50def52011-10-19 23:17:07472 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53473 registrar->Add(observer, content::NOTIFICATION_LOAD_STOP,
[email protected]ad50def52011-10-19 23:17:07474 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53475 registrar->Add(observer, content::NOTIFICATION_RENDERER_PROCESS_CLOSED,
[email protected]ad50def52011-10-19 23:17:07476 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53477 registrar->Add(observer, content::NOTIFICATION_RENDERER_PROCESS_HANG,
[email protected]ad50def52011-10-19 23:17:07478 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53479 registrar->Add(observer, content::NOTIFICATION_CHILD_PROCESS_HOST_CONNECTED,
[email protected]ad50def52011-10-19 23:17:07480 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53481 registrar->Add(observer, content::NOTIFICATION_CHILD_INSTANCE_CREATED,
[email protected]ad50def52011-10-19 23:17:07482 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53483 registrar->Add(observer, content::NOTIFICATION_CHILD_PROCESS_CRASHED,
[email protected]ad50def52011-10-19 23:17:07484 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53485 registrar->Add(observer, chrome::NOTIFICATION_TEMPLATE_URL_SERVICE_LOADED,
[email protected]ad50def52011-10-19 23:17:07486 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53487 registrar->Add(observer, chrome::NOTIFICATION_OMNIBOX_OPENED_URL,
[email protected]ad50def52011-10-19 23:17:07488 content::NotificationService::AllSources());
[email protected]6c2381d2011-10-19 02:52:53489 registrar->Add(observer, chrome::NOTIFICATION_BOOKMARK_MODEL_LOADED,
[email protected]ad50def52011-10-19 23:17:07490 content::NotificationService::AllBrowserContextsAndSources());
[email protected]87ef9ea2011-02-26 03:15:15491}
492
[email protected]432115822011-07-10 15:52:27493void MetricsService::Observe(int type,
[email protected]6c2381d2011-10-19 02:52:53494 const content::NotificationSource& source,
495 const content::NotificationDetails& details) {
[email protected]cac267c2011-09-29 15:18:10496 DCHECK(log_manager_.current_log());
initial.commit09911bf2008-07-26 23:55:29497 DCHECK(IsSingleThreaded());
498
499 if (!CanLogNotification(type, source, details))
500 return;
501
[email protected]432115822011-07-10 15:52:27502 switch (type) {
503 case content::NOTIFICATION_USER_ACTION:
[email protected]cac267c2011-09-29 15:18:10504 log_manager_.current_log()->RecordUserAction(
[email protected]6c2381d2011-10-19 02:52:53505 *content::Details<const char*>(details).ptr());
initial.commit09911bf2008-07-26 23:55:29506 break;
507
[email protected]432115822011-07-10 15:52:27508 case chrome::NOTIFICATION_BROWSER_OPENED:
509 case chrome::NOTIFICATION_BROWSER_CLOSED:
initial.commit09911bf2008-07-26 23:55:29510 LogWindowChange(type, source, details);
511 break;
512
[email protected]432115822011-07-10 15:52:27513 case content::NOTIFICATION_TAB_PARENTED:
514 case content::NOTIFICATION_TAB_CLOSING:
initial.commit09911bf2008-07-26 23:55:29515 LogWindowChange(type, source, details);
516 break;
517
[email protected]432115822011-07-10 15:52:27518 case content::NOTIFICATION_LOAD_STOP:
initial.commit09911bf2008-07-26 23:55:29519 LogLoadComplete(type, source, details);
520 break;
521
[email protected]432115822011-07-10 15:52:27522 case content::NOTIFICATION_LOAD_START:
initial.commit09911bf2008-07-26 23:55:29523 LogLoadStarted();
524 break;
525
[email protected]432115822011-07-10 15:52:27526 case content::NOTIFICATION_RENDERER_PROCESS_CLOSED: {
[email protected]cd69619b2010-05-05 02:41:38527 RenderProcessHost::RendererClosedDetails* process_details =
[email protected]6c2381d2011-10-19 02:52:53528 content::Details<RenderProcessHost::RendererClosedDetails>(
529 details).ptr();
530 RenderProcessHost* host =
531 content::Source<RenderProcessHost>(source).ptr();
[email protected]718eab62011-10-05 21:16:52532 LogRendererCrash(
533 host, process_details->status, process_details->was_alive);
[email protected]1f085622009-12-04 05:33:45534 }
initial.commit09911bf2008-07-26 23:55:29535 break;
536
[email protected]432115822011-07-10 15:52:27537 case content::NOTIFICATION_RENDERER_PROCESS_HANG:
initial.commit09911bf2008-07-26 23:55:29538 LogRendererHang();
539 break;
540
[email protected]432115822011-07-10 15:52:27541 case content::NOTIFICATION_CHILD_PROCESS_HOST_CONNECTED:
542 case content::NOTIFICATION_CHILD_PROCESS_CRASHED:
543 case content::NOTIFICATION_CHILD_INSTANCE_CREATED:
[email protected]a27a9382009-02-11 23:55:10544 LogChildProcessChange(type, source, details);
initial.commit09911bf2008-07-26 23:55:29545 break;
546
[email protected]432115822011-07-10 15:52:27547 case chrome::NOTIFICATION_TEMPLATE_URL_SERVICE_LOADED:
[email protected]6c2381d2011-10-19 02:52:53548 LogKeywords(content::Source<TemplateURLService>(source).ptr());
initial.commit09911bf2008-07-26 23:55:29549 break;
550
[email protected]432115822011-07-10 15:52:27551 case chrome::NOTIFICATION_OMNIBOX_OPENED_URL: {
[email protected]cac267c2011-09-29 15:18:10552 MetricsLog* current_log = log_manager_.current_log()->AsMetricsLog();
[email protected]1226abb2010-06-10 18:01:28553 DCHECK(current_log);
554 current_log->RecordOmniboxOpenedURL(
[email protected]6c2381d2011-10-19 02:52:53555 *content::Details<AutocompleteLog>(details).ptr());
initial.commit09911bf2008-07-26 23:55:29556 break;
[email protected]1226abb2010-06-10 18:01:28557 }
initial.commit09911bf2008-07-26 23:55:29558
[email protected]432115822011-07-10 15:52:27559 case chrome::NOTIFICATION_BOOKMARK_MODEL_LOADED: {
[email protected]6c2381d2011-10-19 02:52:53560 Profile* p = content::Source<Profile>(source).ptr();
[email protected]b61236c62009-04-09 22:43:55561 if (p)
562 LogBookmarks(p->GetBookmarkModel());
initial.commit09911bf2008-07-26 23:55:29563 break;
[email protected]b61236c62009-04-09 22:43:55564 }
initial.commit09911bf2008-07-26 23:55:29565 default:
[email protected]a063c102010-07-22 22:20:19566 NOTREACHED();
initial.commit09911bf2008-07-26 23:55:29567 break;
568 }
[email protected]d01b8732008-10-16 02:18:07569
570 HandleIdleSinceLastTransmission(false);
571
[email protected]cac267c2011-09-29 15:18:10572 if (log_manager_.current_log())
573 DVLOG(1) << "METRICS: NUMBER OF EVENTS = "
574 << log_manager_.current_log()->num_events();
[email protected]d01b8732008-10-16 02:18:07575}
576
577void MetricsService::HandleIdleSinceLastTransmission(bool in_idle) {
578 // If there wasn't a lot of action, maybe the computer was asleep, in which
579 // case, the log transmissions should have stopped. Here we start them up
580 // again.
[email protected]cac78842008-11-27 01:02:20581 if (!in_idle && idle_since_last_transmission_)
[email protected]7f7f1962011-04-20 15:58:16582 StartSchedulerIfNecessary();
[email protected]cac78842008-11-27 01:02:20583 idle_since_last_transmission_ = in_idle;
initial.commit09911bf2008-07-26 23:55:29584}
585
initial.commit09911bf2008-07-26 23:55:29586void MetricsService::RecordStartOfSessionEnd() {
[email protected]466f3c12011-03-23 21:20:38587 LogCleanShutdown();
initial.commit09911bf2008-07-26 23:55:29588 RecordBooleanPrefValue(prefs::kStabilitySessionEndCompleted, false);
589}
590
591void MetricsService::RecordCompletedSessionEnd() {
[email protected]466f3c12011-03-23 21:20:38592 LogCleanShutdown();
initial.commit09911bf2008-07-26 23:55:29593 RecordBooleanPrefValue(prefs::kStabilitySessionEndCompleted, true);
594}
595
[email protected]7f7f1962011-04-20 15:58:16596void MetricsService::RecordBreakpadRegistration(bool success) {
[email protected]68475e602008-08-22 03:21:15597 if (!success)
[email protected]e73c01972008-08-13 00:18:24598 IncrementPrefValue(prefs::kStabilityBreakpadRegistrationFail);
599 else
600 IncrementPrefValue(prefs::kStabilityBreakpadRegistrationSuccess);
601}
602
603void MetricsService::RecordBreakpadHasDebugger(bool has_debugger) {
604 if (!has_debugger)
605 IncrementPrefValue(prefs::kStabilityDebuggerNotPresent);
606 else
[email protected]68475e602008-08-22 03:21:15607 IncrementPrefValue(prefs::kStabilityDebuggerPresent);
[email protected]e73c01972008-08-13 00:18:24608}
609
initial.commit09911bf2008-07-26 23:55:29610//------------------------------------------------------------------------------
611// private methods
612//------------------------------------------------------------------------------
613
614
615//------------------------------------------------------------------------------
616// Initialization methods
617
618void MetricsService::InitializeMetricsState() {
[email protected]79bf0b72009-04-27 21:30:55619#if defined(OS_POSIX)
620 server_url_ = L"https://clients4.google.com/firefox/metrics/collect";
[email protected]d67d1052011-06-09 05:11:41621 // TODO(rtenneti): Return the network stats server name.
622 network_stats_server_ = "";
[email protected]79bf0b72009-04-27 21:30:55623#else
624 BrowserDistribution* dist = BrowserDistribution::GetDistribution();
625 server_url_ = dist->GetStatsServerURL();
[email protected]d67d1052011-06-09 05:11:41626 network_stats_server_ = dist->GetNetworkStatsServer();
[email protected]79bf0b72009-04-27 21:30:55627#endif
628
initial.commit09911bf2008-07-26 23:55:29629 PrefService* pref = g_browser_process->local_state();
630 DCHECK(pref);
631
[email protected]225c50842010-01-19 21:19:13632 if ((pref->GetInt64(prefs::kStabilityStatsBuildTime)
633 != MetricsLog::GetBuildTime()) ||
[email protected]ddd231e2010-06-29 20:35:19634 (pref->GetString(prefs::kStabilityStatsVersion)
[email protected]225c50842010-01-19 21:19:13635 != MetricsLog::GetVersionString())) {
[email protected]541f77922009-02-23 21:14:38636 // This is a new version, so we don't want to confuse the stats about the
637 // old version with info that we upload.
638 DiscardOldStabilityStats(pref);
639 pref->SetString(prefs::kStabilityStatsVersion,
[email protected]ddd231e2010-06-29 20:35:19640 MetricsLog::GetVersionString());
[email protected]225c50842010-01-19 21:19:13641 pref->SetInt64(prefs::kStabilityStatsBuildTime,
642 MetricsLog::GetBuildTime());
[email protected]541f77922009-02-23 21:14:38643 }
644
initial.commit09911bf2008-07-26 23:55:29645 // Update session ID
646 session_id_ = pref->GetInteger(prefs::kMetricsSessionID);
647 ++session_id_;
648 pref->SetInteger(prefs::kMetricsSessionID, session_id_);
649
initial.commit09911bf2008-07-26 23:55:29650 // Stability bookkeeping
[email protected]e73c01972008-08-13 00:18:24651 IncrementPrefValue(prefs::kStabilityLaunchCount);
initial.commit09911bf2008-07-26 23:55:29652
[email protected]e73c01972008-08-13 00:18:24653 if (!pref->GetBoolean(prefs::kStabilityExitedCleanly)) {
654 IncrementPrefValue(prefs::kStabilityCrashCount);
[email protected]c0c55e92011-09-10 18:47:30655 // Reset flag, and wait until we call LogNeedForCleanShutdown() before
656 // monitoring.
657 pref->SetBoolean(prefs::kStabilityExitedCleanly, true);
initial.commit09911bf2008-07-26 23:55:29658 }
[email protected]e73c01972008-08-13 00:18:24659
[email protected]e73c01972008-08-13 00:18:24660 if (!pref->GetBoolean(prefs::kStabilitySessionEndCompleted)) {
661 IncrementPrefValue(prefs::kStabilityIncompleteSessionEndCount);
[email protected]c9abf242009-07-18 06:00:38662 // This is marked false when we get a WM_ENDSESSION.
663 pref->SetBoolean(prefs::kStabilitySessionEndCompleted, true);
initial.commit09911bf2008-07-26 23:55:29664 }
initial.commit09911bf2008-07-26 23:55:29665
[email protected]9165f742010-03-10 22:55:01666 // Initialize uptime counters.
667 int64 startup_uptime = MetricsLog::GetIncrementalUptime(pref);
[email protected]ae393ec702010-06-27 16:23:14668 DCHECK_EQ(0, startup_uptime);
[email protected]9165f742010-03-10 22:55:01669 // For backwards compatibility, leave this intact in case Omaha is checking
670 // them. prefs::kStabilityLastTimestampSec may also be useless now.
671 // TODO(jar): Delete these if they have no uses.
[email protected]0bb1a622009-03-04 03:22:32672 pref->SetInt64(prefs::kStabilityLaunchTimeSec, Time::Now().ToTimeT());
673
674 // Bookkeeping for the uninstall metrics.
675 IncrementLongPrefsValue(prefs::kUninstallLaunchCount);
initial.commit09911bf2008-07-26 23:55:29676
677 // Save profile metrics.
678 PrefService* prefs = g_browser_process->local_state();
679 if (prefs) {
680 // Remove the current dictionary and store it for use when sending data to
681 // server. By removing the value we prune potentially dead profiles
682 // (and keys). All valid values are added back once services startup.
683 const DictionaryValue* profile_dictionary =
684 prefs->GetDictionary(prefs::kProfileMetrics);
685 if (profile_dictionary) {
686 // Do a deep copy of profile_dictionary since ClearPref will delete it.
687 profile_dictionary_.reset(static_cast<DictionaryValue*>(
688 profile_dictionary->DeepCopy()));
689 prefs->ClearPref(prefs::kProfileMetrics);
690 }
691 }
692
[email protected]92745242009-06-12 16:52:21693 // Get stats on use of command line.
694 const CommandLine* command_line(CommandLine::ForCurrentProcess());
695 size_t common_commands = 0;
696 if (command_line->HasSwitch(switches::kUserDataDir)) {
697 ++common_commands;
698 UMA_HISTOGRAM_COUNTS_100("Chrome.CommandLineDatDirCount", 1);
699 }
700
701 if (command_line->HasSwitch(switches::kApp)) {
702 ++common_commands;
703 UMA_HISTOGRAM_COUNTS_100("Chrome.CommandLineAppModeCount", 1);
704 }
705
[email protected]62b4e522011-07-13 21:46:32706 size_t switch_count = command_line->GetSwitches().size();
707 UMA_HISTOGRAM_COUNTS_100("Chrome.CommandLineFlagCount", switch_count);
[email protected]92745242009-06-12 16:52:21708 UMA_HISTOGRAM_COUNTS_100("Chrome.CommandLineUncommonFlagCount",
[email protected]62b4e522011-07-13 21:46:32709 switch_count - common_commands);
[email protected]92745242009-06-12 16:52:21710
initial.commit09911bf2008-07-26 23:55:29711 // Kick off the process of saving the state (so the uptime numbers keep
712 // getting updated) every n minutes.
713 ScheduleNextStateSave();
714}
715
[email protected]d33e7cc2011-09-23 01:43:56716void MetricsService::InitTaskGetHardwareClass(
717 base::MessageLoopProxy* target_loop) {
718 DCHECK(state_ == INIT_TASK_SCHEDULED);
719 DCHECK(BrowserThread::CurrentlyOn(BrowserThread::FILE));
720
721 std::string hardware_class;
722#if defined(OS_CHROMEOS)
723 chromeos::system::StatisticsProvider::GetInstance()->GetMachineStatistic(
724 "hardware_class", &hardware_class);
725#endif // OS_CHROMEOS
726
727 target_loop->PostTask(FROM_HERE,
728 base::Bind(&MetricsService::OnInitTaskGotHardwareClass,
729 base::Unretained(this), hardware_class));
730}
731
732void MetricsService::OnInitTaskGotHardwareClass(
733 const std::string& hardware_class) {
[email protected]85ed9d42010-06-08 22:37:44734 DCHECK(state_ == INIT_TASK_SCHEDULED);
735 hardware_class_ = hardware_class;
[email protected]d33e7cc2011-09-23 01:43:56736
737 // Start the next part of the init task: loading plugin information.
738 PluginService::GetInstance()->GetPlugins(
739 base::Bind(&MetricsService::OnInitTaskGotPluginInfo,
740 base::Unretained(this)));
741}
742
743void MetricsService::OnInitTaskGotPluginInfo(
744 const std::vector<webkit::WebPluginInfo>& plugins) {
745 DCHECK(state_ == INIT_TASK_SCHEDULED);
[email protected]35fa6a22009-08-15 00:04:01746 plugins_ = plugins;
[email protected]d33e7cc2011-09-23 01:43:56747
[email protected]d67d1052011-06-09 05:11:41748 io_thread_ = g_browser_process->io_thread();
[email protected]85ed9d42010-06-08 22:37:44749 if (state_ == INIT_TASK_SCHEDULED)
750 state_ = INIT_TASK_DONE;
initial.commit09911bf2008-07-26 23:55:29751}
752
753std::string MetricsService::GenerateClientID() {
[email protected]3469e7e2010-10-14 20:34:59754 return guid::GenerateGUID();
initial.commit09911bf2008-07-26 23:55:29755}
756
initial.commit09911bf2008-07-26 23:55:29757//------------------------------------------------------------------------------
758// State save methods
759
760void MetricsService::ScheduleNextStateSave() {
761 state_saver_factory_.RevokeAll();
762
763 MessageLoop::current()->PostDelayedTask(FROM_HERE,
764 state_saver_factory_.NewRunnableMethod(&MetricsService::SaveLocalState),
765 kSaveStateInterval * 1000);
766}
767
768void MetricsService::SaveLocalState() {
769 PrefService* pref = g_browser_process->local_state();
770 if (!pref) {
[email protected]a063c102010-07-22 22:20:19771 NOTREACHED();
initial.commit09911bf2008-07-26 23:55:29772 return;
773 }
774
775 RecordCurrentState(pref);
[email protected]6faa0e0d2009-04-28 06:50:36776 pref->ScheduleSavePersistentPrefs();
initial.commit09911bf2008-07-26 23:55:29777
[email protected]281d2882009-01-20 20:32:42778 // TODO(jar): Does this run down the batteries????
initial.commit09911bf2008-07-26 23:55:29779 ScheduleNextStateSave();
780}
781
782
783//------------------------------------------------------------------------------
784// Recording control methods
785
786void MetricsService::StartRecording() {
[email protected]cac267c2011-09-29 15:18:10787 if (log_manager_.current_log())
initial.commit09911bf2008-07-26 23:55:29788 return;
789
[email protected]cac267c2011-09-29 15:18:10790 log_manager_.BeginLoggingWithLog(new MetricsLog(client_id_, session_id_));
initial.commit09911bf2008-07-26 23:55:29791 if (state_ == INITIALIZED) {
792 // We only need to schedule that run once.
[email protected]85ed9d42010-06-08 22:37:44793 state_ = INIT_TASK_SCHEDULED;
initial.commit09911bf2008-07-26 23:55:29794
[email protected]85ed9d42010-06-08 22:37:44795 // Schedules a task on the file thread for execution of slower
796 // initialization steps (such as plugin list generation) necessary
797 // for sending the initial log. This avoids blocking the main UI
798 // thread.
[email protected]a65a33a2011-10-01 16:46:17799 g_browser_process->file_thread()->message_loop()->PostDelayedTask(FROM_HERE,
[email protected]d33e7cc2011-09-23 01:43:56800 base::Bind(&MetricsService::InitTaskGetHardwareClass,
801 base::Unretained(this),
802 MessageLoop::current()->message_loop_proxy()),
[email protected]7f7f1962011-04-20 15:58:16803 kInitializationDelaySeconds * 1000);
initial.commit09911bf2008-07-26 23:55:29804 }
805}
806
[email protected]024b5cd2011-05-27 03:29:38807void MetricsService::StopRecording() {
[email protected]cac267c2011-09-29 15:18:10808 if (!log_manager_.current_log())
initial.commit09911bf2008-07-26 23:55:29809 return;
810
[email protected]68475e602008-08-22 03:21:15811 // TODO(jar): Integrate bounds on log recording more consistently, so that we
812 // can stop recording logs that are too big much sooner.
[email protected]cac267c2011-09-29 15:18:10813 if (log_manager_.current_log()->num_events() > kEventLimit) {
[email protected]553dba62009-02-24 19:08:23814 UMA_HISTOGRAM_COUNTS("UMA.Discarded Log Events",
[email protected]cac267c2011-09-29 15:18:10815 log_manager_.current_log()->num_events());
816 log_manager_.DiscardCurrentLog();
[email protected]68475e602008-08-22 03:21:15817 StartRecording(); // Start trivial log to hold our histograms.
818 }
819
[email protected]cac267c2011-09-29 15:18:10820 // Adds to ongoing logs.
821 log_manager_.current_log()->set_hardware_class(hardware_class_);
[email protected]accdfa62011-09-20 01:56:52822
[email protected]0b33f80b2008-12-17 21:34:36823 // Put incremental data (histogram deltas, and realtime stats deltas) at the
[email protected]147bbc0b2009-01-06 19:37:40824 // end of all log transmissions (initial log handles this separately).
[email protected]024b5cd2011-05-27 03:29:38825 // RecordIncrementalStabilityElements only exists on the derived
826 // MetricsLog class.
[email protected]cac267c2011-09-29 15:18:10827 MetricsLog* current_log = log_manager_.current_log()->AsMetricsLog();
[email protected]024b5cd2011-05-27 03:29:38828 DCHECK(current_log);
829 current_log->RecordIncrementalStabilityElements();
830 RecordCurrentHistograms();
initial.commit09911bf2008-07-26 23:55:29831
[email protected]cac267c2011-09-29 15:18:10832 log_manager_.StageCurrentLogForUpload();
initial.commit09911bf2008-07-26 23:55:29833}
834
[email protected]cac267c2011-09-29 15:18:10835void MetricsService::PushPendingLogsToPersistentStorage() {
initial.commit09911bf2008-07-26 23:55:29836 if (state_ < INITIAL_LOG_READY)
[email protected]28ab7f92009-01-06 21:39:04837 return; // We didn't and still don't have time to get plugin list etc.
initial.commit09911bf2008-07-26 23:55:29838
[email protected]cac267c2011-09-29 15:18:10839 if (log_manager_.has_staged_log()) {
initial.commit09911bf2008-07-26 23:55:29840 if (state_ == INITIAL_LOG_READY) {
841 // We may race here, and send second copy of initial log later.
[email protected]cac267c2011-09-29 15:18:10842 log_manager_.StoreStagedLogAsUnsent(MetricsLogManager::INITIAL_LOG);
843 state_ = SENDING_OLD_LOGS;
initial.commit09911bf2008-07-26 23:55:29844 } else {
[email protected]281d2882009-01-20 20:32:42845 // TODO(jar): Verify correctness in other states, including sending unsent
[email protected]541f77922009-02-23 21:14:38846 // initial logs.
[email protected]cac267c2011-09-29 15:18:10847 log_manager_.StoreStagedLogAsUnsent(MetricsLogManager::ONGOING_LOG);
initial.commit09911bf2008-07-26 23:55:29848 }
initial.commit09911bf2008-07-26 23:55:29849 }
[email protected]cac267c2011-09-29 15:18:10850 DCHECK(!log_manager_.has_staged_log());
[email protected]024b5cd2011-05-27 03:29:38851 StopRecording();
[email protected]cac267c2011-09-29 15:18:10852 log_manager_.StoreStagedLogAsUnsent(MetricsLogManager::ONGOING_LOG);
initial.commit09911bf2008-07-26 23:55:29853 StoreUnsentLogs();
854}
855
856//------------------------------------------------------------------------------
857// Transmission of logs methods
858
[email protected]7f7f1962011-04-20 15:58:16859void MetricsService::StartSchedulerIfNecessary() {
860 if (reporting_active() && recording_active())
861 scheduler_->Start();
initial.commit09911bf2008-07-26 23:55:29862}
863
[email protected]7f7f1962011-04-20 15:58:16864void MetricsService::StartScheduledUpload() {
865 // If reporting has been turned off, the scheduler doesn't need to run.
866 if (!reporting_active() || !recording_active()) {
867 scheduler_->Stop();
868 scheduler_->UploadCancelled();
869 return;
870 }
871
872 DCHECK(!waiting_for_asynchronus_reporting_step_);
873 waiting_for_asynchronus_reporting_step_ = true;
874
[email protected]84c988a2011-04-19 17:56:33875 Task* task = log_sender_factory_.
876 NewRunnableMethod(&MetricsService::OnMemoryDetailCollectionDone);
877
878 scoped_refptr<MetricsMemoryDetails> details(new MetricsMemoryDetails(task));
879 details->StartFetch();
880
881 // Collect WebCore cache information to put into a histogram.
882 for (RenderProcessHost::iterator i(RenderProcessHost::AllHostsIterator());
883 !i.IsAtEnd(); i.Advance())
[email protected]2ccf45c2011-08-19 23:35:50884 i.GetCurrentValue()->Send(new ChromeViewMsg_GetCacheResourceStats());
[email protected]84c988a2011-04-19 17:56:33885}
886
887void MetricsService::OnMemoryDetailCollectionDone() {
[email protected]c9a3ef82009-05-28 22:02:46888 DCHECK(IsSingleThreaded());
[email protected]7f7f1962011-04-20 15:58:16889 // This function should only be called as the callback from an ansynchronous
890 // step.
891 DCHECK(waiting_for_asynchronus_reporting_step_);
[email protected]c9a3ef82009-05-28 22:02:46892
[email protected]7f7f1962011-04-20 15:58:16893 // Right before the UMA transmission gets started, there's one more thing we'd
894 // like to record: the histogram of memory usage, so we spawn a task to
895 // collect the memory details and when that task is finished, it will call
896 // OnMemoryDetailCollectionDone, which will call HistogramSynchronization to
897 // collect histograms from all renderers and then we will call
898 // OnHistogramSynchronizationDone to continue processing.
[email protected]c9a3ef82009-05-28 22:02:46899
900 // Create a callback_task for OnHistogramSynchronizationDone.
901 Task* callback_task = log_sender_factory_.NewRunnableMethod(
902 &MetricsService::OnHistogramSynchronizationDone);
903
904 // Set up the callback to task to call after we receive histograms from all
905 // renderer processes. Wait time specifies how long to wait before absolutely
906 // calling us back on the task.
907 HistogramSynchronizer::FetchRendererHistogramsAsynchronously(
908 MessageLoop::current(), callback_task,
909 kMaxHistogramGatheringWaitDuration);
910}
911
912void MetricsService::OnHistogramSynchronizationDone() {
initial.commit09911bf2008-07-26 23:55:29913 DCHECK(IsSingleThreaded());
914
[email protected]7f7f1962011-04-20 15:58:16915 // If somehow there is a fetch in progress, we return and hope things work
916 // out. The scheduler isn't informed since if this happens, the scheduler
917 // will get a response from the upload.
initial.commit09911bf2008-07-26 23:55:29918 DCHECK(!current_fetch_.get());
[email protected]7f7f1962011-04-20 15:58:16919 if (current_fetch_.get())
920 return;
921
922 // This function should only be called as the callback from an ansynchronous
923 // step.
924 DCHECK(waiting_for_asynchronus_reporting_step_);
925 waiting_for_asynchronus_reporting_step_ = false;
initial.commit09911bf2008-07-26 23:55:29926
[email protected]d01b8732008-10-16 02:18:07927 // If we're getting no notifications, then the log won't have much in it, and
928 // it's possible the computer is about to go to sleep, so don't upload and
[email protected]7f7f1962011-04-20 15:58:16929 // stop the scheduler.
930 // Similarly, if logs should no longer be uploaded, stop here.
931 if (idle_since_last_transmission_ ||
932 !recording_active() || !reporting_active()) {
933 scheduler_->Stop();
934 scheduler_->UploadCancelled();
[email protected]d01b8732008-10-16 02:18:07935 return;
936 }
937
[email protected]cac267c2011-09-29 15:18:10938 MakeStagedLog();
initial.commit09911bf2008-07-26 23:55:29939
[email protected]cac267c2011-09-29 15:18:10940 // MakeStagedLog should have prepared log text; if it didn't, skip this
941 // upload and hope things work out next time.
942 if (log_manager_.staged_log_text().empty()) {
[email protected]7f7f1962011-04-20 15:58:16943 scheduler_->UploadCancelled();
[email protected]d01b8732008-10-16 02:18:07944 return;
945 }
initial.commit09911bf2008-07-26 23:55:29946
[email protected]cac267c2011-09-29 15:18:10947 PrepareFetchWithStagedLog();
[email protected]d01b8732008-10-16 02:18:07948
949 if (!current_fetch_.get()) {
950 // Compression failed, and log discarded :-/.
[email protected]cac267c2011-09-29 15:18:10951 log_manager_.DiscardStagedLog();
[email protected]7f7f1962011-04-20 15:58:16952 scheduler_->UploadCancelled();
[email protected]d01b8732008-10-16 02:18:07953 // TODO(jar): If compression failed, we should have created a tiny log and
954 // compressed that, so that we can signal that we're losing logs.
955 return;
956 }
957
[email protected]7f7f1962011-04-20 15:58:16958 DCHECK(!waiting_for_asynchronus_reporting_step_);
[email protected]d01b8732008-10-16 02:18:07959
[email protected]7f7f1962011-04-20 15:58:16960 waiting_for_asynchronus_reporting_step_ = true;
[email protected]d01b8732008-10-16 02:18:07961 current_fetch_->Start();
962
963 HandleIdleSinceLastTransmission(true);
964}
965
966
[email protected]cac267c2011-09-29 15:18:10967void MetricsService::MakeStagedLog() {
968 if (log_manager_.has_staged_log())
[email protected]d01b8732008-10-16 02:18:07969 return;
970
971 switch (state_) {
972 case INITIALIZED:
[email protected]85ed9d42010-06-08 22:37:44973 case INIT_TASK_SCHEDULED: // We should be further along by now.
[email protected]d01b8732008-10-16 02:18:07974 DCHECK(false);
975 return;
976
[email protected]85ed9d42010-06-08 22:37:44977 case INIT_TASK_DONE:
[email protected]d01b8732008-10-16 02:18:07978 // We need to wait for the initial log to be ready before sending
979 // anything, because the server will tell us whether it wants to hear
980 // from us.
981 PrepareInitialLog();
[email protected]85ed9d42010-06-08 22:37:44982 DCHECK(state_ == INIT_TASK_DONE);
[email protected]cac267c2011-09-29 15:18:10983 log_manager_.LoadPersistedUnsentLogs();
[email protected]d01b8732008-10-16 02:18:07984 state_ = INITIAL_LOG_READY;
985 break;
986
[email protected]d01b8732008-10-16 02:18:07987 case SENDING_OLD_LOGS:
[email protected]cac267c2011-09-29 15:18:10988 if (log_manager_.has_unsent_logs()) {
989 log_manager_.StageNextStoredLogForUpload();
[email protected]d01b8732008-10-16 02:18:07990 break;
991 }
992 state_ = SENDING_CURRENT_LOGS;
993 // Fall through.
994
995 case SENDING_CURRENT_LOGS:
[email protected]024b5cd2011-05-27 03:29:38996 StopRecording();
[email protected]d01b8732008-10-16 02:18:07997 StartRecording();
998 break;
999
1000 default:
[email protected]a063c102010-07-22 22:20:191001 NOTREACHED();
[email protected]d01b8732008-10-16 02:18:071002 return;
1003 }
1004
[email protected]cac267c2011-09-29 15:18:101005 DCHECK(log_manager_.has_staged_log());
[email protected]d01b8732008-10-16 02:18:071006}
1007
initial.commit09911bf2008-07-26 23:55:291008void MetricsService::PrepareInitialLog() {
[email protected]85ed9d42010-06-08 22:37:441009 DCHECK(state_ == INIT_TASK_DONE);
initial.commit09911bf2008-07-26 23:55:291010
1011 MetricsLog* log = new MetricsLog(client_id_, session_id_);
[email protected]85ed9d42010-06-08 22:37:441012 log->set_hardware_class(hardware_class_); // Adds to initial log.
[email protected]35fa6a22009-08-15 00:04:011013 log->RecordEnvironment(plugins_, profile_dictionary_.get());
initial.commit09911bf2008-07-26 23:55:291014
[email protected]cac267c2011-09-29 15:18:101015 // Histograms only get written to the current log, so make the new log current
1016 // before writing them.
1017 log_manager_.PauseCurrentLog();
1018 log_manager_.BeginLoggingWithLog(log);
1019 RecordCurrentHistograms();
initial.commit09911bf2008-07-26 23:55:291020
[email protected]cac267c2011-09-29 15:18:101021 DCHECK(!log_manager_.has_staged_log());
1022 log_manager_.StageCurrentLogForUpload();
1023 log_manager_.ResumePausedLog();
initial.commit09911bf2008-07-26 23:55:291024}
1025
1026void MetricsService::StoreUnsentLogs() {
1027 if (state_ < INITIAL_LOG_READY)
1028 return; // We never Recalled the prior unsent logs.
1029
[email protected]cac267c2011-09-29 15:18:101030 log_manager_.PersistUnsentLogs();
initial.commit09911bf2008-07-26 23:55:291031}
1032
[email protected]cac267c2011-09-29 15:18:101033void MetricsService::PrepareFetchWithStagedLog() {
1034 DCHECK(!log_manager_.staged_log_text().empty());
initial.commit09911bf2008-07-26 23:55:291035 DCHECK(!current_fetch_.get());
[email protected]cac78842008-11-27 01:02:201036
[email protected]79bf0b72009-04-27 21:30:551037 current_fetch_.reset(new URLFetcher(GURL(WideToUTF16(server_url_)),
1038 URLFetcher::POST,
initial.commit09911bf2008-07-26 23:55:291039 this));
[email protected]9abfa192011-07-20 15:48:531040 current_fetch_->set_request_context(
[email protected]8ef3d8052011-07-22 09:03:001041 g_browser_process->system_request_context());
[email protected]cac267c2011-09-29 15:18:101042 current_fetch_->set_upload_data(kMetricsType,
1043 log_manager_.staged_log_text());
initial.commit09911bf2008-07-26 23:55:291044}
1045
[email protected]f90bf0d92011-01-13 02:12:441046static const char* StatusToString(const net::URLRequestStatus& status) {
initial.commit09911bf2008-07-26 23:55:291047 switch (status.status()) {
[email protected]f90bf0d92011-01-13 02:12:441048 case net::URLRequestStatus::SUCCESS:
initial.commit09911bf2008-07-26 23:55:291049 return "SUCCESS";
1050
[email protected]f90bf0d92011-01-13 02:12:441051 case net::URLRequestStatus::IO_PENDING:
initial.commit09911bf2008-07-26 23:55:291052 return "IO_PENDING";
1053
[email protected]f90bf0d92011-01-13 02:12:441054 case net::URLRequestStatus::HANDLED_EXTERNALLY:
initial.commit09911bf2008-07-26 23:55:291055 return "HANDLED_EXTERNALLY";
1056
[email protected]f90bf0d92011-01-13 02:12:441057 case net::URLRequestStatus::CANCELED:
initial.commit09911bf2008-07-26 23:55:291058 return "CANCELED";
1059
[email protected]f90bf0d92011-01-13 02:12:441060 case net::URLRequestStatus::FAILED:
initial.commit09911bf2008-07-26 23:55:291061 return "FAILED";
1062
1063 default:
[email protected]a063c102010-07-22 22:20:191064 NOTREACHED();
initial.commit09911bf2008-07-26 23:55:291065 return "Unknown";
1066 }
1067}
1068
1069void MetricsService::OnURLFetchComplete(const URLFetcher* source,
1070 const GURL& url,
[email protected]f90bf0d92011-01-13 02:12:441071 const net::URLRequestStatus& status,
initial.commit09911bf2008-07-26 23:55:291072 int response_code,
[email protected]cb04f5e2011-05-06 01:10:001073 const net::ResponseCookies& cookies,
initial.commit09911bf2008-07-26 23:55:291074 const std::string& data) {
[email protected]7f7f1962011-04-20 15:58:161075 DCHECK(waiting_for_asynchronus_reporting_step_);
1076 waiting_for_asynchronus_reporting_step_ = false;
initial.commit09911bf2008-07-26 23:55:291077 DCHECK(current_fetch_.get());
1078 current_fetch_.reset(NULL); // We're not allowed to re-use it.
1079
1080 // Confirm send so that we can move on.
[email protected]666205032010-10-21 20:56:581081 VLOG(1) << "METRICS RESPONSE CODE: " << response_code
1082 << " status=" << StatusToString(status);
[email protected]252873ef2008-08-04 21:59:451083
[email protected]7f7f1962011-04-20 15:58:161084 bool upload_succeeded = response_code == 200;
1085
[email protected]0eb34fee2009-01-21 08:04:381086 // Provide boolean for error recovery (allow us to ignore response_code).
[email protected]dc6f4962009-02-13 01:25:501087 bool discard_log = false;
[email protected]0eb34fee2009-01-21 08:04:381088
[email protected]7f7f1962011-04-20 15:58:161089 if (!upload_succeeded &&
[email protected]cac267c2011-09-29 15:18:101090 (log_manager_.staged_log_text().length() >
[email protected]46f89e142010-07-19 08:00:421091 static_cast<size_t>(kUploadLogAvoidRetransmitSize))) {
[email protected]cac267c2011-09-29 15:18:101092 UMA_HISTOGRAM_COUNTS(
1093 "UMA.Large Rejected Log was Discarded",
1094 static_cast<int>(log_manager_.staged_log_text().length()));
[email protected]0eb34fee2009-01-21 08:04:381095 discard_log = true;
1096 } else if (response_code == 400) {
1097 // Bad syntax. Retransmission won't work.
[email protected]553dba62009-02-24 19:08:231098 UMA_HISTOGRAM_COUNTS("UMA.Unacceptable_Log_Discarded", state_);
[email protected]0eb34fee2009-01-21 08:04:381099 discard_log = true;
[email protected]68475e602008-08-22 03:21:151100 }
1101
[email protected]7f7f1962011-04-20 15:58:161102 if (!upload_succeeded && !discard_log) {
[email protected]666205032010-10-21 20:56:581103 VLOG(1) << "METRICS: transmission attempt returned a failure code: "
1104 << response_code << ". Verify network connectivity";
[email protected]7f7f1962011-04-20 15:58:161105 LogBadResponseCode();
[email protected]0eb34fee2009-01-21 08:04:381106 } else { // Successful receipt (or we are discarding log).
[email protected]666205032010-10-21 20:56:581107 VLOG(1) << "METRICS RESPONSE DATA: " << data;
initial.commit09911bf2008-07-26 23:55:291108 switch (state_) {
1109 case INITIAL_LOG_READY:
[email protected]cac267c2011-09-29 15:18:101110 state_ = SENDING_OLD_LOGS;
initial.commit09911bf2008-07-26 23:55:291111 break;
1112
initial.commit09911bf2008-07-26 23:55:291113 case SENDING_OLD_LOGS:
[email protected]d53e2232011-06-30 15:54:571114 // Store the updated list to disk now that the removed log is uploaded.
initial.commit09911bf2008-07-26 23:55:291115 StoreUnsentLogs();
1116 break;
1117
1118 case SENDING_CURRENT_LOGS:
1119 break;
1120
1121 default:
[email protected]a063c102010-07-22 22:20:191122 NOTREACHED();
initial.commit09911bf2008-07-26 23:55:291123 break;
1124 }
[email protected]d01b8732008-10-16 02:18:071125
[email protected]cac267c2011-09-29 15:18:101126 log_manager_.DiscardStagedLog();
[email protected]29be92552008-08-07 22:49:271127 // Since we sent a log, make sure our in-memory state is recorded to disk.
1128 PrefService* local_state = g_browser_process->local_state();
1129 DCHECK(local_state);
1130 if (local_state)
[email protected]6faa0e0d2009-04-28 06:50:361131 local_state->ScheduleSavePersistentPrefs();
[email protected]252873ef2008-08-04 21:59:451132
[email protected]cac267c2011-09-29 15:18:101133 if (log_manager_.has_unsent_logs())
initial.commit09911bf2008-07-26 23:55:291134 DCHECK(state_ < SENDING_CURRENT_LOGS);
initial.commit09911bf2008-07-26 23:55:291135 }
[email protected]252873ef2008-08-04 21:59:451136
[email protected]7f7f1962011-04-20 15:58:161137 // Error 400 indicates a problem with the log, not with the server, so
1138 // don't consider that a sign that the server is in trouble.
1139 bool server_is_healthy = upload_succeeded || response_code == 400;
1140
[email protected]cac267c2011-09-29 15:18:101141 scheduler_->UploadFinished(server_is_healthy,
1142 log_manager_.has_unsent_logs());
[email protected]d67d1052011-06-09 05:11:411143
1144 // Collect network stats if UMA upload succeeded.
1145 if (server_is_healthy && io_thread_)
1146 chrome_browser_net::CollectNetworkStats(network_stats_server_, io_thread_);
initial.commit09911bf2008-07-26 23:55:291147}
1148
[email protected]7f7f1962011-04-20 15:58:161149void MetricsService::LogBadResponseCode() {
[email protected]666205032010-10-21 20:56:581150 VLOG(1) << "Verify your metrics logs are formatted correctly. Verify server "
1151 "is active at " << server_url_;
[email protected]cac267c2011-09-29 15:18:101152 if (!log_manager_.has_staged_log()) {
[email protected]666205032010-10-21 20:56:581153 VLOG(1) << "METRICS: Recorder shutdown during log transmission.";
[email protected]252873ef2008-08-04 21:59:451154 } else {
[email protected]7f7f1962011-04-20 15:58:161155 VLOG(1) << "METRICS: transmission retry being scheduled for "
[email protected]cac267c2011-09-29 15:18:101156 << log_manager_.staged_log_text();
initial.commit09911bf2008-07-26 23:55:291157 }
initial.commit09911bf2008-07-26 23:55:291158}
1159
[email protected]6c2381d2011-10-19 02:52:531160void MetricsService::LogWindowChange(
1161 int type,
1162 const content::NotificationSource& source,
1163 const content::NotificationDetails& details) {
[email protected]534e54b2008-08-13 15:40:091164 int controller_id = -1;
1165 uintptr_t window_or_tab = source.map_key();
initial.commit09911bf2008-07-26 23:55:291166 MetricsLog::WindowEventType window_type;
1167
1168 // Note: since we stop all logging when a single OTR session is active, it is
1169 // possible that we start getting notifications about a window that we don't
1170 // know about.
[email protected]534e54b2008-08-13 15:40:091171 if (window_map_.find(window_or_tab) == window_map_.end()) {
1172 controller_id = next_window_id_++;
1173 window_map_[window_or_tab] = controller_id;
initial.commit09911bf2008-07-26 23:55:291174 } else {
[email protected]534e54b2008-08-13 15:40:091175 controller_id = window_map_[window_or_tab];
initial.commit09911bf2008-07-26 23:55:291176 }
[email protected]92745242009-06-12 16:52:211177 DCHECK_NE(controller_id, -1);
initial.commit09911bf2008-07-26 23:55:291178
[email protected]432115822011-07-10 15:52:271179 switch (type) {
1180 case content::NOTIFICATION_TAB_PARENTED:
1181 case chrome::NOTIFICATION_BROWSER_OPENED:
initial.commit09911bf2008-07-26 23:55:291182 window_type = MetricsLog::WINDOW_CREATE;
1183 break;
1184
[email protected]432115822011-07-10 15:52:271185 case content::NOTIFICATION_TAB_CLOSING:
1186 case chrome::NOTIFICATION_BROWSER_CLOSED:
[email protected]534e54b2008-08-13 15:40:091187 window_map_.erase(window_map_.find(window_or_tab));
initial.commit09911bf2008-07-26 23:55:291188 window_type = MetricsLog::WINDOW_DESTROY;
1189 break;
1190
1191 default:
[email protected]a063c102010-07-22 22:20:191192 NOTREACHED();
[email protected]68d74f02009-02-13 01:36:501193 return;
initial.commit09911bf2008-07-26 23:55:291194 }
1195
[email protected]534e54b2008-08-13 15:40:091196 // TODO(brettw) we should have some kind of ID for the parent.
[email protected]cac267c2011-09-29 15:18:101197 log_manager_.current_log()->RecordWindowEvent(window_type, controller_id, 0);
initial.commit09911bf2008-07-26 23:55:291198}
1199
[email protected]6c2381d2011-10-19 02:52:531200void MetricsService::LogLoadComplete(
1201 int type,
1202 const content::NotificationSource& source,
1203 const content::NotificationDetails& details) {
[email protected]ad50def52011-10-19 23:17:071204 if (details == content::NotificationService::NoDetails())
initial.commit09911bf2008-07-26 23:55:291205 return;
1206
[email protected]68475e602008-08-22 03:21:151207 // TODO(jar): There is a bug causing this to be called too many times, and
1208 // the log overflows. For now, we won't record these events.
[email protected]553dba62009-02-24 19:08:231209 UMA_HISTOGRAM_COUNTS("UMA.LogLoadComplete called", 1);
[email protected]68475e602008-08-22 03:21:151210 return;
1211
[email protected]6c2381d2011-10-19 02:52:531212 const content::Details<LoadNotificationDetails> load_details(details);
[email protected]534e54b2008-08-13 15:40:091213 int controller_id = window_map_[details.map_key()];
[email protected]cac267c2011-09-29 15:18:101214 log_manager_.current_log()->RecordLoadEvent(controller_id,
1215 load_details->url(),
1216 load_details->origin(),
1217 load_details->session_index(),
1218 load_details->load_time());
initial.commit09911bf2008-07-26 23:55:291219}
1220
[email protected]57ecc4b2010-08-11 03:02:511221void MetricsService::IncrementPrefValue(const char* path) {
[email protected]e73c01972008-08-13 00:18:241222 PrefService* pref = g_browser_process->local_state();
1223 DCHECK(pref);
1224 int value = pref->GetInteger(path);
1225 pref->SetInteger(path, value + 1);
1226}
1227
[email protected]57ecc4b2010-08-11 03:02:511228void MetricsService::IncrementLongPrefsValue(const char* path) {
[email protected]0bb1a622009-03-04 03:22:321229 PrefService* pref = g_browser_process->local_state();
1230 DCHECK(pref);
1231 int64 value = pref->GetInt64(path);
[email protected]b42c5e42010-06-03 20:43:251232 pref->SetInt64(path, value + 1);
[email protected]0bb1a622009-03-04 03:22:321233}
1234
initial.commit09911bf2008-07-26 23:55:291235void MetricsService::LogLoadStarted() {
[email protected]dd8d12a2011-09-02 02:10:151236 HISTOGRAM_ENUMERATION("Chrome.UmaPageloadCounter", 1, 2);
[email protected]e73c01972008-08-13 00:18:241237 IncrementPrefValue(prefs::kStabilityPageLoadCount);
[email protected]0bb1a622009-03-04 03:22:321238 IncrementLongPrefsValue(prefs::kUninstallMetricsPageLoadCount);
[email protected]0b33f80b2008-12-17 21:34:361239 // We need to save the prefs, as page load count is a critical stat, and it
1240 // might be lost due to a crash :-(.
initial.commit09911bf2008-07-26 23:55:291241}
1242
[email protected]718eab62011-10-05 21:16:521243void MetricsService::LogRendererCrash(RenderProcessHost* host,
1244 base::TerminationStatus status,
1245 bool was_alive) {
1246 Profile* profile = Profile::FromBrowserContext(host->browser_context());
1247 ExtensionProcessManager* extension_process_manager =
1248 profile->GetExtensionProcessManager();
1249 bool was_extension_process = extension_process_manager ?
1250 extension_process_manager->IsExtensionProcess(host->id()) :
1251 false;
1252 if (status == base::TERMINATION_STATUS_PROCESS_CRASHED ||
1253 status == base::TERMINATION_STATUS_ABNORMAL_TERMINATION) {
1254 if (was_extension_process)
1255 IncrementPrefValue(prefs::kStabilityExtensionRendererCrashCount);
1256 else
1257 IncrementPrefValue(prefs::kStabilityRendererCrashCount);
initial.commit09911bf2008-07-26 23:55:291258
[email protected]718eab62011-10-05 21:16:521259 UMA_HISTOGRAM_PERCENTAGE("BrowserRenderProcessHost.ChildCrashes",
1260 was_extension_process ? 2 : 1);
1261 if (was_alive) {
1262 UMA_HISTOGRAM_PERCENTAGE("BrowserRenderProcessHost.ChildCrashesWasAlive",
1263 was_extension_process ? 2 : 1);
1264 }
1265 } else if (status == base::TERMINATION_STATUS_PROCESS_WAS_KILLED) {
1266 UMA_HISTOGRAM_PERCENTAGE("BrowserRenderProcessHost.ChildKills",
1267 was_extension_process ? 2 : 1);
1268 if (was_alive) {
1269 UMA_HISTOGRAM_PERCENTAGE("BrowserRenderProcessHost.ChildKillsWasAlive",
1270 was_extension_process ? 2 : 1);
1271 }
1272 }
[email protected]1f085622009-12-04 05:33:451273}
1274
initial.commit09911bf2008-07-26 23:55:291275void MetricsService::LogRendererHang() {
[email protected]e73c01972008-08-13 00:18:241276 IncrementPrefValue(prefs::kStabilityRendererHangCount);
initial.commit09911bf2008-07-26 23:55:291277}
1278
[email protected]c0c55e92011-09-10 18:47:301279void MetricsService::LogNeedForCleanShutdown() {
1280 PrefService* pref = g_browser_process->local_state();
1281 pref->SetBoolean(prefs::kStabilityExitedCleanly, false);
1282 // Redundant setting to be sure we call for a clean shutdown.
1283 clean_shutdown_status_ = NEED_TO_SHUTDOWN;
1284}
1285
1286bool MetricsService::UmaMetricsProperlyShutdown() {
1287 CHECK(clean_shutdown_status_ == CLEANLY_SHUTDOWN ||
1288 clean_shutdown_status_ == NEED_TO_SHUTDOWN);
1289 return clean_shutdown_status_ == CLEANLY_SHUTDOWN;
1290}
1291
[email protected]67c4e952011-09-17 00:44:271292// For use in hack in LogCleanShutdown.
1293static void Signal(base::WaitableEvent* event) {
1294 event->Signal();
1295}
1296
[email protected]466f3c12011-03-23 21:20:381297void MetricsService::LogCleanShutdown() {
[email protected]acd55b32011-09-05 17:35:311298 // Redundant hack to write pref ASAP.
1299 PrefService* pref = g_browser_process->local_state();
1300 pref->SetBoolean(prefs::kStabilityExitedCleanly, true);
1301 pref->SavePersistentPrefs();
[email protected]67c4e952011-09-17 00:44:271302 // Hack: TBD: Remove this wait.
1303 // We are so concerned that the pref gets written, we are now willing to stall
1304 // the UI thread until we get assurance that a pref-writing task has
1305 // completed.
1306 base::WaitableEvent done_writing(false, false);
1307 BrowserThread::PostTask(BrowserThread::FILE, FROM_HERE,
1308 NewRunnableFunction(Signal, &done_writing));
1309 done_writing.TimedWait(base::TimeDelta::FromHours(1));
1310
[email protected]c0c55e92011-09-10 18:47:301311 // Redundant setting to assure that we always reset this value at shutdown
1312 // (and that we don't use some alternate path, and not call LogCleanShutdown).
1313 clean_shutdown_status_ = CLEANLY_SHUTDOWN;
[email protected]acd55b32011-09-05 17:35:311314
[email protected]466f3c12011-03-23 21:20:381315 RecordBooleanPrefValue(prefs::kStabilityExitedCleanly, true);
1316}
1317
[email protected]c1834a92011-01-21 18:21:031318#if defined(OS_CHROMEOS)
1319void MetricsService::LogChromeOSCrash(const std::string &crash_type) {
1320 if (crash_type == "user")
1321 IncrementPrefValue(prefs::kStabilityOtherUserCrashCount);
1322 else if (crash_type == "kernel")
1323 IncrementPrefValue(prefs::kStabilityKernelCrashCount);
1324 else if (crash_type == "uncleanshutdown")
1325 IncrementPrefValue(prefs::kStabilitySystemUncleanShutdownCount);
1326 else
1327 NOTREACHED() << "Unexpected Chrome OS crash type " << crash_type;
1328 // Wake up metrics logs sending if necessary now that new
1329 // log data is available.
1330 HandleIdleSinceLastTransmission(false);
1331}
1332#endif // OS_CHROMEOS
1333
[email protected]a27a9382009-02-11 23:55:101334void MetricsService::LogChildProcessChange(
[email protected]432115822011-07-10 15:52:271335 int type,
[email protected]6c2381d2011-10-19 02:52:531336 const content::NotificationSource& source,
1337 const content::NotificationDetails& details) {
1338 content::Details<ChildProcessInfo> child_details(details);
[email protected]68b9e72b2011-08-05 23:08:221339 const string16& child_name = child_details->name();
[email protected]0d84c5d2009-10-09 01:10:421340
[email protected]a27a9382009-02-11 23:55:101341 if (child_process_stats_buffer_.find(child_name) ==
1342 child_process_stats_buffer_.end()) {
[email protected]0d84c5d2009-10-09 01:10:421343 child_process_stats_buffer_[child_name] =
1344 ChildProcessStats(child_details->type());
initial.commit09911bf2008-07-26 23:55:291345 }
1346
[email protected]a27a9382009-02-11 23:55:101347 ChildProcessStats& stats = child_process_stats_buffer_[child_name];
[email protected]432115822011-07-10 15:52:271348 switch (type) {
1349 case content::NOTIFICATION_CHILD_PROCESS_HOST_CONNECTED:
initial.commit09911bf2008-07-26 23:55:291350 stats.process_launches++;
1351 break;
1352
[email protected]432115822011-07-10 15:52:271353 case content::NOTIFICATION_CHILD_INSTANCE_CREATED:
initial.commit09911bf2008-07-26 23:55:291354 stats.instances++;
1355 break;
1356
[email protected]432115822011-07-10 15:52:271357 case content::NOTIFICATION_CHILD_PROCESS_CRASHED:
initial.commit09911bf2008-07-26 23:55:291358 stats.process_crashes++;
[email protected]1f085622009-12-04 05:33:451359 // Exclude plugin crashes from the count below because we report them via
1360 // a separate UMA metric.
1361 if (child_details->type() != ChildProcessInfo::PLUGIN_PROCESS) {
1362 IncrementPrefValue(prefs::kStabilityChildProcessCrashCount);
1363 }
initial.commit09911bf2008-07-26 23:55:291364 break;
1365
1366 default:
[email protected]432115822011-07-10 15:52:271367 NOTREACHED() << "Unexpected notification type " << type;
initial.commit09911bf2008-07-26 23:55:291368 return;
1369 }
1370}
1371
1372// Recursively counts the number of bookmarks and folders in node.
[email protected]b3c33d462009-06-26 22:29:201373static void CountBookmarks(const BookmarkNode* node,
1374 int* bookmarks,
1375 int* folders) {
[email protected]0890e60e2011-06-27 14:55:211376 if (node->is_url())
initial.commit09911bf2008-07-26 23:55:291377 (*bookmarks)++;
1378 else
1379 (*folders)++;
[email protected]9c1a75a2011-03-10 02:38:121380 for (int i = 0; i < node->child_count(); ++i)
initial.commit09911bf2008-07-26 23:55:291381 CountBookmarks(node->GetChild(i), bookmarks, folders);
1382}
1383
[email protected]b3c33d462009-06-26 22:29:201384void MetricsService::LogBookmarks(const BookmarkNode* node,
[email protected]57ecc4b2010-08-11 03:02:511385 const char* num_bookmarks_key,
1386 const char* num_folders_key) {
initial.commit09911bf2008-07-26 23:55:291387 DCHECK(node);
1388 int num_bookmarks = 0;
1389 int num_folders = 0;
1390 CountBookmarks(node, &num_bookmarks, &num_folders);
1391 num_folders--; // Don't include the root folder in the count.
1392
1393 PrefService* pref = g_browser_process->local_state();
1394 DCHECK(pref);
1395 pref->SetInteger(num_bookmarks_key, num_bookmarks);
1396 pref->SetInteger(num_folders_key, num_folders);
1397}
1398
[email protected]d8e41ed2008-09-11 15:22:321399void MetricsService::LogBookmarks(BookmarkModel* model) {
initial.commit09911bf2008-07-26 23:55:291400 DCHECK(model);
[email protected]72bdcfe2011-07-22 17:21:581401 LogBookmarks(model->bookmark_bar_node(),
initial.commit09911bf2008-07-26 23:55:291402 prefs::kNumBookmarksOnBookmarkBar,
1403 prefs::kNumFoldersOnBookmarkBar);
1404 LogBookmarks(model->other_node(),
1405 prefs::kNumBookmarksInOtherBookmarkFolder,
1406 prefs::kNumFoldersInOtherBookmarkFolder);
1407 ScheduleNextStateSave();
1408}
1409
[email protected]8e5c89a2011-06-07 18:13:331410void MetricsService::LogKeywords(const TemplateURLService* url_model) {
initial.commit09911bf2008-07-26 23:55:291411 DCHECK(url_model);
1412
1413 PrefService* pref = g_browser_process->local_state();
1414 DCHECK(pref);
1415 pref->SetInteger(prefs::kNumKeywords,
1416 static_cast<int>(url_model->GetTemplateURLs().size()));
1417 ScheduleNextStateSave();
1418}
1419
1420void MetricsService::RecordPluginChanges(PrefService* pref) {
[email protected]f8628c22011-04-05 12:10:181421 ListPrefUpdate update(pref, prefs::kStabilityPluginStats);
1422 ListValue* plugins = update.Get();
initial.commit09911bf2008-07-26 23:55:291423 DCHECK(plugins);
1424
1425 for (ListValue::iterator value_iter = plugins->begin();
1426 value_iter != plugins->end(); ++value_iter) {
1427 if (!(*value_iter)->IsType(Value::TYPE_DICTIONARY)) {
[email protected]a063c102010-07-22 22:20:191428 NOTREACHED();
initial.commit09911bf2008-07-26 23:55:291429 continue;
1430 }
1431
1432 DictionaryValue* plugin_dict = static_cast<DictionaryValue*>(*value_iter);
[email protected]57ecc4b2010-08-11 03:02:511433 std::string plugin_name;
[email protected]8e50b602009-03-03 22:59:431434 plugin_dict->GetString(prefs::kStabilityPluginName, &plugin_name);
[email protected]6470ee8f2009-03-03 20:46:401435 if (plugin_name.empty()) {
[email protected]a063c102010-07-22 22:20:191436 NOTREACHED();
initial.commit09911bf2008-07-26 23:55:291437 continue;
1438 }
1439
[email protected]57ecc4b2010-08-11 03:02:511440 // TODO(viettrungluu): remove conversions
[email protected]68b9e72b2011-08-05 23:08:221441 string16 name16 = UTF8ToUTF16(plugin_name);
1442 if (child_process_stats_buffer_.find(name16) ==
1443 child_process_stats_buffer_.end()) {
initial.commit09911bf2008-07-26 23:55:291444 continue;
[email protected]68b9e72b2011-08-05 23:08:221445 }
initial.commit09911bf2008-07-26 23:55:291446
[email protected]68b9e72b2011-08-05 23:08:221447 ChildProcessStats stats = child_process_stats_buffer_[name16];
initial.commit09911bf2008-07-26 23:55:291448 if (stats.process_launches) {
1449 int launches = 0;
[email protected]8e50b602009-03-03 22:59:431450 plugin_dict->GetInteger(prefs::kStabilityPluginLaunches, &launches);
initial.commit09911bf2008-07-26 23:55:291451 launches += stats.process_launches;
[email protected]8e50b602009-03-03 22:59:431452 plugin_dict->SetInteger(prefs::kStabilityPluginLaunches, launches);
initial.commit09911bf2008-07-26 23:55:291453 }
1454 if (stats.process_crashes) {
1455 int crashes = 0;
[email protected]8e50b602009-03-03 22:59:431456 plugin_dict->GetInteger(prefs::kStabilityPluginCrashes, &crashes);
initial.commit09911bf2008-07-26 23:55:291457 crashes += stats.process_crashes;
[email protected]8e50b602009-03-03 22:59:431458 plugin_dict->SetInteger(prefs::kStabilityPluginCrashes, crashes);
initial.commit09911bf2008-07-26 23:55:291459 }
1460 if (stats.instances) {
1461 int instances = 0;
[email protected]8e50b602009-03-03 22:59:431462 plugin_dict->GetInteger(prefs::kStabilityPluginInstances, &instances);
initial.commit09911bf2008-07-26 23:55:291463 instances += stats.instances;
[email protected]8e50b602009-03-03 22:59:431464 plugin_dict->SetInteger(prefs::kStabilityPluginInstances, instances);
initial.commit09911bf2008-07-26 23:55:291465 }
1466
[email protected]68b9e72b2011-08-05 23:08:221467 child_process_stats_buffer_.erase(name16);
initial.commit09911bf2008-07-26 23:55:291468 }
1469
1470 // Now go through and add dictionaries for plugins that didn't already have
1471 // reports in Local State.
[email protected]68b9e72b2011-08-05 23:08:221472 for (std::map<string16, ChildProcessStats>::iterator cache_iter =
[email protected]a27a9382009-02-11 23:55:101473 child_process_stats_buffer_.begin();
1474 cache_iter != child_process_stats_buffer_.end(); ++cache_iter) {
[email protected]a27a9382009-02-11 23:55:101475 ChildProcessStats stats = cache_iter->second;
[email protected]0d84c5d2009-10-09 01:10:421476
1477 // Insert only plugins information into the plugins list.
1478 if (ChildProcessInfo::PLUGIN_PROCESS != stats.process_type)
1479 continue;
1480
[email protected]57ecc4b2010-08-11 03:02:511481 // TODO(viettrungluu): remove conversion
[email protected]68b9e72b2011-08-05 23:08:221482 std::string plugin_name = UTF16ToUTF8(cache_iter->first);
[email protected]0d84c5d2009-10-09 01:10:421483
initial.commit09911bf2008-07-26 23:55:291484 DictionaryValue* plugin_dict = new DictionaryValue;
1485
[email protected]8e50b602009-03-03 22:59:431486 plugin_dict->SetString(prefs::kStabilityPluginName, plugin_name);
1487 plugin_dict->SetInteger(prefs::kStabilityPluginLaunches,
initial.commit09911bf2008-07-26 23:55:291488 stats.process_launches);
[email protected]8e50b602009-03-03 22:59:431489 plugin_dict->SetInteger(prefs::kStabilityPluginCrashes,
initial.commit09911bf2008-07-26 23:55:291490 stats.process_crashes);
[email protected]8e50b602009-03-03 22:59:431491 plugin_dict->SetInteger(prefs::kStabilityPluginInstances,
initial.commit09911bf2008-07-26 23:55:291492 stats.instances);
1493 plugins->Append(plugin_dict);
1494 }
[email protected]a27a9382009-02-11 23:55:101495 child_process_stats_buffer_.clear();
initial.commit09911bf2008-07-26 23:55:291496}
1497
[email protected]6c2381d2011-10-19 02:52:531498bool MetricsService::CanLogNotification(
1499 int type,
1500 const content::NotificationSource& source,
1501 const content::NotificationDetails& details) {
[email protected]2c910b72011-03-08 21:16:321502 // We simply don't log anything to UMA if there is a single incognito
initial.commit09911bf2008-07-26 23:55:291503 // session visible. The problem is that we always notify using the orginal
1504 // profile in order to simplify notification processing.
1505 return !BrowserList::IsOffTheRecordSessionActive();
1506}
1507
[email protected]57ecc4b2010-08-11 03:02:511508void MetricsService::RecordBooleanPrefValue(const char* path, bool value) {
initial.commit09911bf2008-07-26 23:55:291509 DCHECK(IsSingleThreaded());
1510
1511 PrefService* pref = g_browser_process->local_state();
1512 DCHECK(pref);
1513
1514 pref->SetBoolean(path, value);
1515 RecordCurrentState(pref);
1516}
1517
1518void MetricsService::RecordCurrentState(PrefService* pref) {
[email protected]0bb1a622009-03-04 03:22:321519 pref->SetInt64(prefs::kStabilityLastTimestampSec, Time::Now().ToTimeT());
initial.commit09911bf2008-07-26 23:55:291520
1521 RecordPluginChanges(pref);
1522}
1523
initial.commit09911bf2008-07-26 23:55:291524static bool IsSingleThreaded() {
[email protected]ce072a72010-12-31 20:02:161525 static base::PlatformThreadId thread_id = 0;
initial.commit09911bf2008-07-26 23:55:291526 if (!thread_id)
[email protected]ce072a72010-12-31 20:02:161527 thread_id = base::PlatformThread::CurrentId();
1528 return base::PlatformThread::CurrentId() == thread_id;
initial.commit09911bf2008-07-26 23:55:291529}
[email protected]5ccaa412009-11-13 22:00:161530
1531#if defined(OS_CHROMEOS)
[email protected]29cf16772010-04-21 15:13:471532void MetricsService::StartExternalMetrics() {
[email protected]5ccaa412009-11-13 22:00:161533 external_metrics_ = new chromeos::ExternalMetrics;
[email protected]29cf16772010-04-21 15:13:471534 external_metrics_->Start();
[email protected]5ccaa412009-11-13 22:00:161535}
1536#endif
[email protected]3819f2ee2011-08-21 09:44:381537
1538// static
1539bool MetricsServiceHelper::IsMetricsReportingEnabled() {
1540 bool result = false;
1541 const PrefService* local_state = g_browser_process->local_state();
1542 if (local_state) {
1543 const PrefService::Preference* uma_pref =
1544 local_state->FindPreference(prefs::kMetricsReportingEnabled);
1545 if (uma_pref) {
1546 bool success = uma_pref->GetValue()->GetAsBoolean(&result);
1547 DCHECK(success);
1548 }
1549 }
1550 return result;
1551}