Hello,

I'm very sorry to disturb, it should be something very simple, but I spent an hour with no success.
My config:

<?xml version="1.0" encoding="utf-8"?>
<Influx-Capacitor>
  <Database Type="InfluxDB" Enabled="true">
    <Url>http://influxdb_domain_name:8086</Url>
    <Username>capacitor</Username>
    <Password>capacitor</Password>
    <Name>my_db</Name>
    <RequestTimeoutMs>15000</RequestTimeoutMs>
  </Database>
</Influx-Capacitor>

when I try to test it in console with config show I always get:
Unable to connect to database
however I'm able to query influxdb with curl:

>Invoke-WebRequest http://influxdb_domain_name:8086/query?q='SHOW DATABASES'
StatusCode        : 200
StatusDescription : OK
Content           : {"results":[{"series":[{"name":"databases","columns":["name"],"values":[["general"],["my_db"]]}]}]}
RawContent        : HTTP/1.1 200 OK

I have:
Influx-capacitor 1.0.17, influxdb 0.9.6.1, windows 2012R2

Any advice would be greatly appreciated.

Hi,

I use Influx Capacitor for several monthes and I am very happy with it.
Thanks for this great piece of software !!!

Since our organization if growing, we got some problems with InfluxDB and have sometimes to put it offline for several minutes/hours for maintenance.
One of our engineers who is also working in ELK proposed us to implement Kafka (see http://kafka.apache.org/) to put it between our multiple Influx-Capacitors and our InlfuxDBs.
It mainly allows us to be able to "bufferize" perfmon data streams before they reach InfluxDB (and, when everything is working well, have the smallest possible delay to reach InfluxDB).
It is highly scalable and has very high throughput.

Do you think it is possible to implement a second backend type (to Kafka) in Influx-Capacitor ?
Our engineer said that it takes not that much time to write this extension on usual tools (we have others internal projects that we rewrote to ship to Kafka instead of directly to InfluxDB or Elastic).
I'am sorry I can't help because I am an op with to few knowledge in development ...

Format submitted could be a standard JSON. Only time and value should be float, others should be strings. For example :

 [{
                "measurement": "sys.cpu",
                "time": 1443085314552,
                "value": 10.0,
                "tags": {
                    "collector": "influx-capacitor",
                    "fqdn": "my-test-hostname",
                    "ecosystem": "myapp",
                    "role": "mssql",
                    "os": "Windows",
                    "osrelease": "2012R2",
                    "unit": "percent",
                    "category1": "user",
                     "core": "0"
                }
},
{
                "measurement": "sys.cpu",
                "time": 1443085314552,
                "value": 15.43,
                "tags": {
                    "collector": "influx-capacitor",
                    "fqdn": "my-test-hostname",
                    "ecosystem": "myapp",
                    "role": "mssql",
                    "os": "Windows",
                    "osrelease": "2012R2",
                    "unit": " percent ",
                    "category1": "idle",
                     "core": "1"
                }
}]

Tell me what you think of that idea !
Thanks.

According to #47, nowadays is not possible to define the timeout of http request sent to influxdb.

Looking at MSDN documentation, the default value of the timeout property is 100 seconds (100.000 miliseconds) and I think this very high. If influxdb is slow to respond, probably the queue will increase fast (I don't know what behavior of capacitor about retries when sending collected data results in error, reenquee?).

Have control of timeout property should help a lot.

Documentation:
https://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.timeout(v=vs.100).aspx

After discussions with collegues, they argued that possibility to create many tags on InfluxDB can be an advantage to make some global queries more simple and get most advantage of InfluxDB features.
For example, creating "perfmon.processor.pct_user", "perfmon.processor.pct_system" and "perfmon.processor.pct_irq" will quickly force us to make many queries and merge the results.

Using only the field names of perfmon (countercategory, countername, instance) is too a little restrictive.

It should be better to have someting more generic for measure names, like "perfmon.processor", "perfmon.disk".
And then using tags to add deeper view (like "consumer" in ['user','system','irq', ...] for cpu, or "pattern" in ['read','write'], ...).
And we could also add some other tags like "unit" ['pct','seconds','megabyte_per_sec','io_per_second'...].

That would make querying easier and more human readable.

That is, somewhere, a way to "translate" the perfmon hierarchy.
For that point, it would be also useful to be able to "copy" the "instance" tag values under another tag name (defined at counter level), because sometime we can't just make asumptions on some counter instance, like different disk names, number of cores, network card name, etc. ...

Not sure I am very clear, an example of possible implementation in config files would help you to understand:

<CounterGroups>
    <CounterGroup Name="system.cpu" SecondsInterval="5">
        <Counter>
            <CategoryName>Processor</CategoryName>
            <CounterName>% Processor Time</CounterName>
            <InstanceName>*</InstanceName>
            <CounterTag>
                <Name>measure</Name>
                <Value>usage</Value>
            </CounterTag>
            <CounterTag>
                <Name>unit</Name>
                <Value>pct</Value>
            </CounterTag>
            <InstanceTagAlias>
                <Name>core</Name>
            </InstanceTagAlias>
      </Counter>
    </CounterGroup>
</CounterGroups>
etc. ...

We would obtain something like:

_select * from system.cpu_
time                   measure       unit    core    value   (...)
2016-01-01T01:01:01Z   "usage"       "pct"   "0"     12.564  (...)
2016-01-01T01:01:01Z   "usage"       "pct"   "1"      9.947  (...)
2016-01-01T01:01:01Z   "usage"       "pct"   "2"     28.197  (...)
2016-01-01T01:01:01Z   "usage"       "pct"   "3"     82.073  (...)
2016-01-01T01:01:01Z   "frequency"   "mhz"   "0"     3600    (...)
2016-01-01T01:01:01Z   "frequency"   "mhz"   "1"     3000    (...)
2016-01-01T01:01:01Z   "frequency"   "mhz"   "2"     3000    (...)
2016-01-01T01:01:01Z   "frequency"   "mhz"   "3"     3000    (...)
etc. ...

I know it is a big change from the actual approach (which is closer to perfmon view). In fact, in our usage, other system (linuxes, firewalls, apps), will be collected by different tools and we want to get a global approach that make both global analysis and develoment of grafana dashboards easy.

I think this kind of naming convention (all-tagged approach with flexibility at counter level) is more mature and makes sense.

Let me know what you think about that !

I was planning to use Capacitor to send perfmon counters to influxdb, but after some tests I wanted to change the point schema to allow a more compact schema.

Actually, when datas are sent to InfluxDB, the schema follows a convention where two tags "category" and "counter" are used with a single value:

time            category  counter          instance  hostname     value
20150203002300  Memory    Available Bytes  _Total    SERVER1   15766000
20150203002300  Memory    Committed Bytes  _Total    SERVER1     460000
20150203004300  Memory    Available Bytes  _Total    SERVER1   15966000
20150203004300  Memory    Committed Bytes  _Total    SERVER1     440000

In my opinion, this schema a some pro:

• better discoverability
• easy to use

But also some cons:

• higher memory footprint (more tags)
• values is more apples and oranges (could be percents and values in the same field)

So, my suggestion is to find a way to use a more compact schema, similar to the schema sent by tools such as telegraph:

time            hostname  free_bytes  committed_bytes
20150203002300  SERVER1     15766000           460000
20150203004300  SERVER1     15966000           440000

In this case, we have now one single point with all values (and no tags). It will certainly have some limitations.

I have a PR ready to enhance the configuration and the behavior of the program to allow sending this kind of schema. It is an opt-in option, where the modified code will only be triggered when this option is used. I am really new to this project (only have used it in tests so far), so I hope I could help you anyway. Comments are welcome :)

Regards,

A nice feature to have would be possibility to read counters not only from localhost but from different machine(s).

Hello,

First, I would like to thank you for this project, it is exactly what I need to monitor machines (locally or remotely)!

Now my issue: I finally managed to configure InfluxDB access, and this works ('config show' generates a successful 'ping' to InfluxDB).
However, I cannot configure counters, even standard ones.
I created two XML files for metrics:

<?xml version="1.0" encoding="utf-16"?>
<Influx-Capacitor>
  <CounterGroups>
    <CounterGroup Name="processor" SecondsInterval="10">
      <Counter>
        <CategoryName>Processor</CategoryName>
        <CounterName>% Processor Time</CounterName>
        <InstanceName>*</InstanceName>
      </Counter>
      <Counter>
        <CategoryName>Processeur</CategoryName>
        <CounterName>% temps processeur</CounterName>
        <InstanceName>*</InstanceName>
      </Counter>
    </CounterGroup>
  </CounterGroups>
</Influx-Capacitor>

and

<?xml version="1.0" encoding="utf-16"?>
<Influx-Capacitor>
  <CounterGroups>
    <CounterGroup Name="processor2" SecondsInterval="5" RefreshInstanceInterval="0">
      <Counter>
        <CategoryName>Processor</CategoryName>
        <CounterName>% Processor Time</CounterName>
        <InstanceName>_Total</InstanceName>
      </Counter>
    </CounterGroup>
  </CounterGroups>
</Influx-Capacitor>

Please note that my Win7 SP1 is installed in French, so I tried both English and French names for perf counters.
I activated service log file and got these lines:

WARN - 24/04/2016 22:20:02: Unable to get performance counter .Processor.% Processor Time.*. La catégorie n'existe pas.
WARN - 24/04/2016 22:20:02: Unable to get performance counter .Processeur.% temps processeur.*. La catégorie n'existe pas.
ERROR - 24/04/2016 22:20:02: Engine processor: La référence d'objet n'est pas définie à une instance d'un objet.
WARN - 24/04/2016 22:20:02: Unable to get performance counter .Processor.% Processor Time._Total. La catégorie n'existe pas.
ERROR - 24/04/2016 22:20:02: Engine processor2: La référence d'objet n'est pas définie à une instance d'un objet.
INFO - 24/04/2016 22:20:02: Service Influx-Capacitor version 1.0.18.0 started.
ERROR - 24/04/2016 22:20:07: Engine processor2: La référence d'objet n'est pas définie à une instance d'un objet.
ERROR - 24/04/2016 22:20:12: Engine processor: La référence d'objet n'est pas définie à une instance d'un objet.
ERROR - 24/04/2016 22:20:12: Engine processor2: La référence d'objet n'est pas définie à une instance d'un objet.

In English it says that the category does not exist, which is rather annoying for Processor (English) or Processeur (French). Note that perfmon find these categories with no problem.
Finally I tried to create the counter directly in console (see attached PNG file).

I enter category 'Processor' -> OK
I enter counter '% Processor Time' -> NOK ('There are several matches to the entry')
If I enter counter '% Processor Time' -> OK, but counter not found!

Thanx for your help!
Stéphane.

I am trying to monitor remote machine. I am passing IP Address as the MachineName in my configuration file. But it does not seem to collect the counters from the remote machine. Also, I am not joined to domain. Do the machine need to be on same domain??

Some percent based counters are known for returning values more than 100, which could be confusing for further processing. This is "behavior is by design" as Microsoft says: https://support.microsoft.com/en-us/kb/310067 👎
I suggest providing a way to fix percent based values that are more than 100.

When I look at data, tag values text includes double quotes at beginning and ending :

show TAG VALUES from processor WITH KEY=hostname

returns something like:

"MyHost1"
"MyHost2"

And for query select * from processor limit 1:

time    category    counter hostname    instance    value
2015-09-04T07:54:06Z    ""Processor""   ""% Processor Time""    ""MyHost1"" ""0""   7.587343

That forces me to make all my queries with text tags enclosed by double quotes and simple quotes :

select * from processor where hostname='"MyHost1"'

Is it normal ?

Thanks.

PS: This application is great, exactly what i was searching for monthes 👍

When using wildcards on InstanceNames the counters are named as the search criteria, not as the name of the counter.

For some reason, all our servers stopped sending datas to influxdb after midnight yesterday.
I was able to reproduce the problem using server console:

InfluxDb API responded with status code=BadRequest, response={"error":"write fai
led: field type conflict: input field \"queueCountChange\" on measurement \"Infl
ux-Capacitor-Metadata\" is type float64, already exists as type integer"}

For now I am looging at the code to see if I find the culprit.

The installed version was 1.0.15.

Use case: I'm trying to peek various memory related counters for all the Microsoft Exchange processes. The ability to use wild-cards helps a lot, e.g. I use <InstanceName>*Exchange*</InstanceName> to grab all the processes that have Exchange in their names. But this does not cover all the exchange processes, because there is store, msftefd, msftesql, etc. For each of those, apparently I'll have to copy / paste the same Counter section. Instead, it would be nice to use several InstanceName sections within a single Counter section.

Hi,

I am trying to set the Influx Capacitor to work with Exchange Server 2013 (Windows Server 2012 R2).
However I got an issue with performance counter (MSExchange Database ==> Instances and Counter name = I/O Database Reads (Attached) Average Latency).
When I start the service, it shows the errors below.
1- Engine MSExchange Database ==> Instances: Object reference not set to an instance of an object.
2- Unable to get performance counter MSExchange Database ==> Instances.I/O Database Reads (Attached) Average Latency.. Category does not exist.

I tried to use the escape characters ( >) but did not work.

All others performance counters worked well, only this one is not working.

Do you have any work around for this?

Tks

Data do gets sent to influx 0.9v but:
the tags have "" around them making them not usable?
"show tag keys from Processor" returns nothing, also the time column is not epoch meaning its corrupt?
tried with grafana and cant graph anything :/

I have an internal requirement that could be adressed: we are using azure sql database, and performance counters for the database are only available through the sys.dm_od_performance_counters view.

My idea is to add an abstraction around performance counters to allow arbitrary providers to provide counters values.

It is similar to issues #28 and #46, but I do not want (for now) to expose them as performance counters for the system. It seems to be a lot easier to just provide IPerformanceCounterInfos instead of registering in the system new performance counters (it requires some admin rights and configuration to works).

This work will requires some steps:

• Create a new abstraction around the code which transform an ICounterGroup into IPerformanceCounterInfo
• Extract from CounterBusiness all works related to system performance counters in a new PerformanceCounterProvider. For simplicity, hard-code usage of thie provider into CounterBusiness
• Add a way to select the provider in xml configuration
• Provide provider's specific settings in xml.
• Create a new SqlDmvPerformanceCounterProvider which will create IPerformanceCounterInfo based on an sql server statement

I will track this work in my own "abstract-perfcounterbusiness" branch for now.

I will try to fix the issues #28 and #46 with this work. The plugin feature could requires some big changes in the code (copy/paste plugin assemblies, dynamic registration, dependency injection, etc.)

In my monitoring system, normally I check the state of a service to ensure that is running.
When monitor influx-capacitor service, even its running we have no guarantees that it is collecting data. For example, if connection to database is unavailable:

Log Name: Application
Source: Tharga.Toolkit.Console
Date: 26/02/2016 10:06:30
Event ID: 0
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: ComputerName
Description:
Could not establish a connection to the database.

We could have an option to configure an URL where the service will send current state at specific times, and possible error messages like database unavailable. It would work as a heartbeat monitoring.

Something like this:

<Influx-Capacitor>
  <HealthCheck Type="Nagios|OpsMgr|Custom" Enabled="true" SecondsInterval="60" SendErrorMessages="true">
    <MachineName>MyComputer</MachineName>
    <Url>http://mymonitor.com/AgentStatus</Url>
  </HealthCheck>
<Influx-Capacitor>

Before using InfluxDB I was using graphite, and a powershell script to send data to graphite.

One of the useful feature this tool has was the ability to rename and filter counters based on regular expressions.

See an example in StatsToGraphite.xml, in elements <MetricsCleaning> and <Filtering>

I am facing a problem that requires the kind of same functionality on capacitor.

The problem arise when collecting IIS and ASP.NET counters, in categories W3SVC_W3WP and WAS_W3WP: the instance name is composed of the pid and the application pool name (see this doc).
So instances names varies when processes are started/recycled. So, it is impossible to filter by instance name, and we can not send this instance name as a tag, because the value will change too often.

Basically two features are needed:

• the ability to filter instances based on a regular expression (better than the actual wildcard)
• the ability to rename instances to remove the varying part (the pid)

My idea for now is:

Add a new <InstanceFilters> element under <CounterGroup>. Within this element, you can add multiple <Filter> element.
Each <Filter> must define a Pattern attribute with a regular expression, and an optional Replacement pattern.

During counter reading, each filter is applied to the instances returned by the performance counter.

• If the filter only defines the Pattern property, then the instance name is matched against it. If it matches, then the function returns the instance name unchanged. If it doesn't it returns null.
• If the filter defines both Pattern and Replacement, then the replacement is executed and the result is returned.
• Each filter is executing, using the instance name returned from the previous, until all have been applied or until a filter returns a null value.)

If an instance name is null after the filters pass, the counter is ignored. Otherwise, the value is read and the process continue.
The new instance name is used when sending the value to the collector.

Configuration example:

<InstanceFilters>
  <!-- this filter will exclude all instance names where ".NET" is not present in the instance name -->
  <Filter Pattern="\.NET" />
  <!-- this filter will remove all pids from instance names for IIS apps. "1879_.NET v4.5" => ".NET v4.5" -->
  <Filter Pattern="^\d+_(.*)$" Replacement="$1" />
  <!-- this filter will replace ".NET v4.5" by "net45" -->
  <Filter Pattern="\.NET v4\.5" Replacement="net45" />
</InstanceFilters>

Possible enhancements:

• possibility to share filter groups with other counter groups
• possibility to define filter to specific counters
• possibility to simplify the pattern when we want to match a simple string (remove the necessary \ before dots)

Do you think this feature could fit the project ? I have some prototype already, but I prefer to be sure that I am not missing anything or that I am going in the right direction.

It appears that IC stops sending data when a counter instance momentarily disappeas, such as when a service is restarted.

I'm seeing this with IIS counters - if IIS is restarted, IC must also be restarted or no data shows up.

Hi,

I'm facing some issues with agent, where sometimes, the collector service is up but no data is sent to influxdb. I've installed the agent in a lot of servers, and many of then has the same behavior.
Restarting service fix the issue, but it happens again after no specific time.

Have you ever faced this behavior?

There's an option to enable trace or detailed log to help understand what is happening?

Regards,

I've just updated my back-end server to InfluxDB 0.10.0 and the capacitor service is now unable to send the data there. I guess, the problem is that the service uses InfluxVersion.Auto when creating a database connection object instance.

It seems that you use your own version of InfluxDB.NET.dll, because the original one does not have InfluxVersion enumeration at all, however I could not find the source code of your fork. I suppose it's the InfluxDB.NET.dll code that needs to be fixed for 0.10.

Please fix and provide a link the source code.

It is a bit messy to keep track of all servers and how Influx-Capacitor is configured on them.

nathanwebb suggested a way of configuring them from one central point.

My idea here would be a simple service exposing a WebAPI that Influx-Capacitor can talk to. What you need to do then is just pointing Influx-Capacitor to the http address and the configurations will be read from there.

Hi! I try setup server from console .\Tharga.Influx-Capacitor.Console.exe server config but i simply cant type : . When paste url from buffer it appears trimmed. http://localhost become http//localhost

Microsoft Windows Server 2012 R2 Standard

P.S. Can you provide example of server config? I will create it manually ;)

Hi,

Firstly, this is a great tool. It didn't take very long to hook up, and is pretty much exactly what I was looking for.
Installed it couple of days ago, with assistance with the database.xml file, and started to see stats immediately. Which is great, because I can see a memory leak in the Tharga.Influx-Capacitor.Service. Here are a couple of charts to show what I mean:

Firstly the working set - 1.4GB in 24 hours.

As a result, page fault have gone through the roof in the last few hours:

I'm going to restart the service, but if you need any logs, or whatever else, please let me know.

Cheers,
Nathan

Hello,

looking at the source code, in the ConfigBusiness class, has no swtich option to influxdb (actually is empty). That will be default behavior or is a typo error?

namespace Tharga.InfluxCapacitor.Collector.Business
{
private static IEnumerable GetDatabaseConfig(XmlDocument document)
{
var databases = document.GetElementsByTagName("Database");
foreach (XmlNode database in databases)
{
var databaseType = GetDatabaseType(database);
switch (databaseType)
{
case "null":
yield return GetNullDatabaseConfig(database);
break;
case "acc":
yield return GetAccDatabaseConfig(database);
break;
case "kafka":
yield return GetKafkaDatabaseConfig(database);
break;
case "":
yield return GetInfluxDatabaseConfig(database);
break;
default:
throw new ArgumentOutOfRangeException(string.Format("There is no database type with name {0}.", databaseType));
}
}
}
}

Hi,

It would be really handy to get the current system configuration, such as Total installed RAM. Unfortunately perfmon doesn't provide these counters. Without this, it's pretty hard to figure out current memory utilisation.

I don't know anything about C#, but found this MSDN guide:

https://msdn.microsoft.com/en-us/library/windows/desktop/aa366589%28v=vs.85%29.aspx

Other details that help with capacity planning are number and type of CPUs, number and size of disks, number of network interfaces, etc...

Make it possible to monitor the following... (As suggested by nathanwebb)

• Total installed ram
• CPUs
• disks
• network interfaces
  (Data as count, type and other)

My idea is to expose the metrics as a performance counter that can be monitored by perfmon and used as any other counter by Influx-Capacitor.

It's a very common situation where is required collect details about the server and not only performance counters. For example:

• how many websites exists in IIS
• amount of used and free space on each physical disks.
• installed applications
  I think if the service allows the usage of plugins and execute wmi queries would be good.
  Probably, this is related to #28

Do not send the counters one-by-one. Group them together and send data to the server.

Make the send interval configurable.

I have an HP server and I installed the "HPE Insight Management WBEM Providers for Windows Server x64 Editions", which gives all sorts of fun things such as HP_NumericSensor (temp reading) and HP_PowerMeter. Naturally, I'd love to ship these metrics to InfluxDB to make pretty graphs.

Unfortunately, CIM stuff doesn't seem to be supported.

I have a strange bug on several setups that has big impact as I try to generalize Influx-Capacitor in my servers and I get many failures.

It seems to occur more frequently with many counters and high collect rates (in my situation : about 800 counters collected every 10 seconds and refreshed every 30 collects, sent to DB every 20 second).
In these situations, errors like "engine my.custom.metrics": Dropping x keys. appear in the event log.
Then no metrics go to InfluxDB and the process takes more and more memory, and does not respond to stop service requests.
It seems that putting lower collect or db-send refresh rates or db refresh rate makes this thing happen a few times less (at the beginning my setup was 5 sec collect and feed to DB).

The behaviour is also reproductible from console with "counter collect" command.

Perhaps it has something to do with first connexion to InfluxDB ?
Our environments feeds to 2 InfluxDB but I also had the problem with only 1 InfluxDB.

Make it possible to get specific instances through wildcard expression :

Process (sql*) \ % processor time
Would collect for all processes beginning with sql etc

Check out collectw on github which does that by regex.

I can't seem to get this to run on server2003, even if I rebuild for 32 bit or 64 bit only.

Any idea what I'm missing here?

Send metadata about the performance of the influx-capacitor to influxDB as a separate counter.

Record the time it takes to read counters, information about the queue and by how much the Exact counter is adjusted to be in sync.

This feature should be optional and configurable.

It would be nice to add in the configuration (globally or at counter level) the ability to add custom tags (with static key+value) that would be added to all metrics sent to Influx.

For example, on all servers I would like to get a tag called "Project" and, on each machine, I would put the name of the related project.
That would allow me to query easily all performance counters of all machines for a specified project:

select min(value) 
from disk 
where time > now() - 1h 
and category='"LogicalDisk"' and counter='"% Idle Time"' 
and project='Gamma'
group by hostname,instance

Thanks !

Hi,

I would like to propose a little enhancement : is it possible to add an auto-refresh of all counters (like when I do a "counter list" in the console) in a regular time basis (every x minutes or hours) ?
I have for example counters on SQL Server on databases (counter instance = *), so each time I create a new db, I have to refresh the counters to get the new db metrics.

Thanks for your great work !

Hello guys!

I'm facing some issues mentioned on #64 #59 and #47 but i'm not sure that occurs by the same reasons.
The servers reporting to InfluxDB constantly stops to send data and I can't figure it out why.

At first instance, I've though that this issue was related with some dynamic counters, like the example bellow (this is the entire configuration but the point is the counter Current Connections):

<?xml version="1.0" encoding="utf-8"?>
<Influx-Capacitor>
  <CounterGroups>
    <CounterGroup Name="web-server" SecondsInterval="60" RefreshInstanceInterval="300">
      <Counter>
        <CategoryName>Active Server Pages</CategoryName>
        <CounterName>Requests Queued</CounterName>
        <InstanceName></InstanceName>
    <FieldName>asp_requests_queued</FieldName>
        <Tag>
          <Name>requests_queue</Name>
          <Value>asp_classic</Value>
        </Tag>
      </Counter>
      <Counter>
        <CategoryName>Active Server Pages</CategoryName>
        <CounterName>Requests/Sec</CounterName>
        <InstanceName></InstanceName>
    <FieldName>asp_requests_sec</FieldName>
        <Tag>
          <Name>requests_per_sec</Name>
          <Value>asp_classic</Value>
        </Tag>
      </Counter>
      <Counter>
        <CategoryName>ASP.NET</CategoryName>
        <CounterName>Requests Current</CounterName>
        <InstanceName></InstanceName>        
    <FieldName>asp_current_requests</FieldName>
      </Counter>
      <Counter>
        <CategoryName>ASP.NET</CategoryName>
        <CounterName>Requests Queued</CounterName>
        <InstanceName></InstanceName>
    <FieldName>aspnet_requests_queued</FieldName>
        <Tag>
          <Name>requests_queue</Name>
          <Value>asp_net</Value>
        </Tag>
      </Counter>
      <Counter>
        <CategoryName>APP_POOL_WAS</CategoryName>
        <CounterName>Current Worker Processes</CounterName>
        <InstanceName>_Total</InstanceName>
    <FieldName>current_worker_processes</FieldName>
        <Tag>
          <Name>web-server-usage</Name>
          <Value>worker-processes-running</Value>
        </Tag>
      </Counter>
      <Counter>
        <CategoryName>W3SVC_W3WP</CategoryName>
        <CounterName>Active Requests</CounterName>
        <InstanceName>_Total</InstanceName>
    <FieldName>active_requests</FieldName>
        <Tag>
          <Name>web-server-usage</Name>
          <Value>active-requests</Value>
        </Tag>
      </Counter>
      <Counter>
        <CategoryName>Web Service</CategoryName>
        <CounterName>Current Connections</CounterName>
        <InstanceName>*</InstanceName>
    <FieldName>current_connections</FieldName>
      </Counter>
    </CounterGroup>
  </CounterGroups>
</Influx-Capacitor>

This configuration brings me counters for every website installed on a server but, because this server got new websites installed and other websites are deleted every time, new counters will always appears or fade away, causing error Engine web-server: Object reference not set to an instance of an object. (#59). Apparently this error was solved after add an value to RefreshInstanceInterval, but the problem of servers stopping send data wasn't.

Right now, I'm stucked with some servers that stopped to send data to the endpoint on a few hours ago but, the last log was wrote about two days ago. The error generated it's available bellow (no logs were generated in same time the Influx-Capacitor stops sent data):

ERROR - Log entry string is too long. A string written to the event log cannot exceed 32766 characters.
System.ArgumentException: Log entry string is too long. A string written to the event log cannot exceed 32766 characters.
   at System.Diagnostics.EventLogInternal.InternalWriteEvent(UInt32 eventID, UInt16 category, EventLogEntryType type, String[] strings, Byte[] rawData, String currentMachineName)
   at System.Diagnostics.EventLogInternal.WriteEntry(String message, EventLogEntryType type, Int32 eventID, Int16 category, Byte[] rawData)
   at System.Diagnostics.EventLog.WriteEntry(String source, String message, EventLogEntryType type, Int32 eventID, Int16 category, Byte[] rawData)
   at Tharga.Toolkit.Console.Command.Base.ServerConsole.WriteLineEx(String value, OutputLevel level)
   at Tharga.Toolkit.Console.Command.Base.SystemConsoleBase.WriteLine(String value, OutputLevel level, Nullable`1 consoleColor)
   at Tharga.InfluxCapacitor.Service.WindowsService.SendBusinessEvent(Object sender, SendCompleteEventArgs e)
   at Tharga.InfluxCapacitor.Collector.Business.SendBusiness.OnSendBusinessEvent(Object sender, SendCompleteEventArgs e)
   at Tharga.Influx_Capacitor.Sender.InfluxDataSender.OnSendBusinessEvent(SendCompleteEventArgs e)
   at Tharga.Influx_Capacitor.Sender.InfluxDataSender.Send()
   at Tharga.InfluxCapacitor.Collector.Business.SendBusiness.Elapsed(Object sender, ElapsedEventArgs e)
ERROR - One or more errors occurred.
. . . 
A LOT OF DATA 
. . .
ERROR - 22/05/2016 06:53:06: An error occurred while sending the request.
WARN - 22/05/2016 06:53:06: Putting 634 points back in the queue.

No other logs are available on Event Viewer or in the log file. The queue is empty. The only other information logged was this one (which doesn't match with the time where server stops sending data):

ERROR - 21/05/2016 06:18:09: InfluxDb API responded with status code=BadRequest, response={"error":"partial write:\nunable to parse 'Influx-Capacitor-Metadata,counter=queueCount,hostname=HOSTNAME,version=1.0.18.0,action=Send,targetServer=http://ENDPOINT,targetDatabase=DATABASE,failMessage=InfluxDb\\ API\\ responded\\ with\\ status\\ code\\=BadRequest\\,\\ response\\={\"error\":\"partial\\ write:\\nunable\\ to\\ parse\\ 'Influx-Capacitor-Metadata\\,counter\\=queueCount\\,hostname\\=HOSTNAME\\,version\\=1.0.18.0\\,action\\=Send\\,targetServer\\=http://ENDPOINT\\,targetDatabase\\=DATABASE\\,failMessage\\=InfluxDb\\\\\\ API\\\\\\ responded\\\\\\ with\\\\\\ status\\\\\\ code\\\\\\=BadRequest\\\\\\,\\\\\\ response\\\\\\={\\\"error\\\":\\\"unable\\\\\\ to\\\\\\ parse\\\\\\ 'Influx-Capacitor-Metadata\\\\\\,counter\\\\\\=queueCount\\\\\\,hostname\\\\\\=HOSTNAME\\\\\\,version\\\\\\=1.0.18.0\\\\\\,action\\\\\\=Send\\\\\\,targetServer\\\\\\=http://ENDPOINT\\\\\\,targetDatabase\\\\\\=DATABASE\\\\\\,failMessage\\\\\\=InfluxDb\\\\\\\\\\\\\\ API\\\\\\\\\\\\\\ responded\\\\\\\\\\\\\\ with\\\\\\\\\\\\\\ status\\\\\\\\\\\\\\ code\\\\\\\\\\\\\\=ServiceUnavailable\\\\\\\\\\\\\\,\\\\\\\\\\\\\\ response\\\\\\\\\\\\\\=\\\\u003chtml\\\\u003e\\\\u003cbody\\\\u003e\\\\u003ch1\\\\u003e503\\\\\\\\\\\\\\ Service\\\\\\\\\\\\\\ Unavailable\\\\u003c/h1\\\\u003e':\\\\\\ missing\\\\\\ fields\\\\nunable\\\\\\ to\\\\\\ parse\\\\\\ 'No\\\\\\\\\\\\\\ server\\\\\\\\\\\\\\ is\\\\\\\\\\\\\\ available\\\\\\\\\\\\\\ to\\\\\\\\\\\\\\ handle\\\\\\\\\\\\\\ this\\\\\\\\\\\\\\ request.':\\\\\\ missing\\\\\\ fields\\\\nunable\\\\\\ to\\\\\\ parse\\\\\\ '\\\\u003c/body\\\\u003e\\\\u003c/html\\\\u003e':\\\\\\ missing\\\\\\ fields\\\"}':\\ missing\\ fields\\nunable\\ to\\ parse\\ 'value\\=1.0\\,queueCountChange\\=-594i\\,sendTimeMs\\=4062.0\\ 1463822245574':\\ invalid\\ field\\ format\"}': missing fields\nunable to parse 'value=31.0,queueCountChange=0i,sendTimeMs=17766.0 1463822279293': invalid field format"}

WARN - 21/05/2016 06:18:09: Dropping 52 since the exception type InfluxDB.Net.Infrastructure.Influx.InfluxDbApiException is not allowed for resend.
ERROR - One or more errors occurred.

This issue is temporarily fixed only when Influx-Capacitor is restarted.
I'm using Capacitor 1.0.18.0.

Hi,

It seems the new InfluxDataSenderConfiguration constructor raises a RuntimeBinderException on Properties.Url = url because the dynamic object is not initialized.

It seems you should add Properties = new System.Dynamic.ExpandoObject(); for the code to execute.

I think my request is perhaps not-so-simple to implement, but it would be interesting if we could define more than 1 InfluxDB target.
In my environment we would like to feed 2 different InfluxDB (on 2 different sites), and a simple approach would be to dual feed (other approaches like InfluxDB proxy or clusters do not seem to be reliable for the moment).
What do you think about that ?

I'm not entirely sure where to go with this one... but I'm trying to pull counters from
.NET CLR Remoting - Remote Calls/sec

Locally from performance monitor, I can see all the instances on the machine.
Influx Capacitor seems only able to see itself, and the Global instance - both which indicate 0 all the time.

Global on the performance-monitor view shows me what I'd expect.

It smells like a permission issue, but even with the service running as the same user as I use interactively, I get different results.

Any help greatly appreciated.

See https://github.com/poxet/Influx-Capacitor/blob/master/Samples/disk.xml#L75

avergae must be average

Hi,
I'm facing the issue as follows:
I have Influx-capacitor (checked both 1.18.0.0 and 1.18.0.3 version) installed on one of my hosts and try to collect perfmon counters from couple of remote machines. I use console version just to watch it working, but it behaves the same way with the service version. After some time from the counter start I can see a sequence of messages like:

Engine A: Dropping X steps.
Engine A: Dropping X steps.
Engine A: Dropping X steps.
Engine A: Dropping X steps.
Engine B: Dropping X steps.
Engine A: Dropping X steps.
Engine A: Dropping X steps.
Engine A: Missing 6 cycles. Resetting and starting over.

...and the application stops logging data into database. The only way to make it functional again is restart (in case of service - kill the process - as stop action on the service is timing out).
I use InfluxDB ver. 0.12.2 and Grafana ver. 3.0.0-beta7 (also tried 3.0.0-beta5)

Best Regards
Tomasz

If the console application is not started with elevated security, is not able to update the configuration files.

Have the console elevate security when updating configuration, as is done when restarting the service.

Not sure I missed something, but I don't find it easy to automate the Influx-Capacitor setup without having sometimes a problem.

I succeded it by creating the "C:\ProgramData\Thargelion\Influx-Capacitor*.xml" directories and files, and then call the msi setup with /q parameter, but if, for example, the influxdb server is temporary unreachable, setup will be stuck on the Influx-Capacitor console with the error message.

Would it be possible to have a command line parameter that always exits silently (no blocking) with just a message and an exit code to be checked ?

Many thanks for this usefull tool !

I would recommend to add a line in the InfluxCapacitor description that it is not yet compatible with InfluxDB 0.11.

The problem lies in InfluxDB.Net that is very specific about InfluxDB version

Please see https://github.com/ziyasal/InfluxDB.Net/blob/master/InfluxDB.Net/Client/InfluxDbClientAutoVersion.cs#L24

Cheers!

Grafana 2.1pre build now has good support for influx 0.9 tags and measurments. Your tool could be what the windows shops out there need if u get it right.

Good luck!

If connection to influx is interrupted the service stops.

The service also stops, and does not start again, if there are other issues.