Comments (4)
kenylieou
commented on August 17, 2024
Hi @paulincai Is there any url using montiapm that you can able to share in order to reproduce?
from prerender-request-blacklist.
paulincai
commented on August 17, 2024
Hi @kenylieou. Very nice of you to get back. I use a Meteor Web App. I know what MontiAPM is but I can't say that I know its internals so I cannot present too much background of it. Monti is a monitoring tool for Meteor (traditionally known as Kadira). There is a Monti "client" installed on the Node server which communicates permanently with the MontiAPM server (https://app.montiapm.com/) and transmits analytics like memory and CPU used by the Node server, number of subscriptions to Mongo, time of response to queries etc. If you check the body tag of my SPA at https://www.activitree.com, at the bottom you find the Meteor JS bundle where Monti is showing. Like in the image below.
from prerender-request-blacklist.
kenylieou
commented on August 17, 2024
In your logs:
2019-03-18T12:17:14.430Z - 0 https://engine.montiapm.com/simplentp/sync
2019-03-18T12:17:14.432Z + 1 https://engine.montiapm.com/simplentp/sync
You are turning logRequests: true, do you see something like
- BLOCK https://www.google-analytics.com/analytics.js by rule domain:google-analytics.com
2019-03-20T08:20:24.863Z + 1 https://www.google-analytics.com/analytics.js
2019-03-20T08:20:24.887Z - 0 https://www.google-analytics.com/analytics.js
in your console?
btw, do you enable ENABLE_SERVICE_WORKER=true of prerender?
from prerender-request-blacklist.
paulincai
commented on August 17, 2024
do you enable ENABLE_SERVICE_WORKER=true of prerender?
No.
My Prerender Server JS file:
var prerender = require('prerender');
var redis = require('redis')
const client = redis.createClient()
var server = prerender({
logRequests: true
});
// server.use(require('prerender-request-blacklist'));
process.env.PAGE_TTL = 3600 * 24 * 7; // change to 0 if you want all time cache
server.use(require('prerender-redis-cache'));
server.use(prerender.sendPrerenderHeader());
server.use(prerender.blockResources());
server.use(prerender.removeScriptTags());
server.use(prerender.httpHeaders());
// server.use(prerender.basicAuth());
server.start();
A full log when I prerender (Fetch as Google):
2019-03-22T18:36:16.275Z getting https://www.activitree.com/education/type=all&curr=Canadian
2019-03-22T18:36:16.380Z + 1 https://www.activitree.com/education/type=all&curr=Canadian
2019-03-22T18:36:16.507Z - 0 https://www.activitree.com/education/type=all&curr=Canadian
2019-03-22T18:36:16.527Z + 1 https://www.activitree.com/81c5d84a966fa05d60cc294a8115a98e1910ac90.css?meteor_css_resource=true
2019-03-22T18:36:16.528Z + 2 https://www.activitree.com/87879f8e69875bd8123eea1099de5a67ff26599c.js?meteor_js_resource=true
2019-03-22T18:36:16.559Z - 1 https://www.activitree.com/81c5d84a966fa05d60cc294a8115a98e1910ac90.css?meteor_css_resource=true
2019-03-22T18:36:16.608Z - 0 https://www.activitree.com/87879f8e69875bd8123eea1099de5a67ff26599c.js?meteor_js_resource=true
2019-03-22T18:36:17.075Z + 1 https://www.activitree.com/sockjs/info?cb=scbb2vcvlr
2019-03-22T18:36:17.112Z + 2 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:17.119Z - 1 https://www.activitree.com/sockjs/info?cb=scbb2vcvlr
2019-03-22T18:36:17.170Z - 0 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:17.380Z + 1 https://www.google-analytics.com/analytics.js
2019-03-22T18:36:17.398Z - 0 https://www.google-analytics.com/analytics.js
2019-03-22T18:36:17.402Z + 1 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:17.452Z - 0 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:17.482Z + 1 https://assets.activitree.com/icons/logo360.png
2019-03-22T18:36:17.513Z - 0 https://assets.activitree.com/icons/logo360.png
2019-03-22T18:36:17.638Z + 1 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:17.703Z - 0 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:17.705Z level: log text: [object Object] url: /imports/ui/pages/education/EduPage.js line: 1
2019-03-22T18:36:17.706Z level: log text: Activitree Education | Schools and Nurseries in UAE url: /imports/ui/pages/education
/EduPage.js line: 1
2019-03-22T18:36:17.723Z level: log text: [object Object] url: /imports/ui/pages/education/EduPage.js line: 1
2019-03-22T18:36:17.723Z level: log text: Activitree Education | Canadian Curriculum | Schools and Nurseries in UAE url: /impo
rts/ui/pages/education/EduPage.js line: 1
2019-03-22T18:36:17.728Z + 1 https://assets.activitree.com/images/logo-colorx120.png
2019-03-22T18:36:17.745Z - 0 https://assets.activitree.com/images/logo-colorx120.png
2019-03-22T18:36:17.786Z level: log text: [object Object] url: /imports/ui/pages/education/EduPage.js line: 1
2019-03-22T18:36:17.787Z level: log text: Activitree Education | Canadian Curriculum | Schools and Nurseries in UAE url: /impo
rts/ui/pages/education/EduPage.js line: 1
2019-03-22T18:36:17.833Z + 1 https://assets.activitree.com/icons/edu.jpg
2019-03-22T18:36:17.834Z + 2 https://assets.activitree.com/icons/gmap.jpg
2019-03-22T18:36:17.883Z - 1 https://assets.activitree.com/icons/edu.jpg
2019-03-22T18:36:17.885Z - 0 https://assets.activitree.com/icons/gmap.jpg
2019-03-22T18:36:18.880Z + 1 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:18.916Z - 0 https://www.activitree.com/__meteor__/dynamic-import/fetch
2019-03-22T18:36:22.126Z + 1 https://engine.montiapm.com/errors
2019-03-22T18:36:22.195Z - 0 https://engine.montiapm.com/errors
2019-03-22T18:36:22.198Z + 1 https://engine.montiapm.com/errors
2019-03-22T18:36:22.255Z - 0 https://engine.montiapm.com/errors
2019-03-22T18:36:27.064Z + 1 https://engine.montiapm.com/simplentp/sync
2019-03-22T18:36:27.096Z - 0 https://engine.montiapm.com/simplentp/sync
2019-03-22T18:36:27.100Z + 1 https://engine.montiapm.com/simplentp/sync
2019-03-22T18:36:27.141Z - 0 https://engine.montiapm.com/simplentp/sync
2019-03-22T18:36:36.377Z page timed out https://www.activitree.com/education/type=all&curr=Canadian
2019-03-22T18:36:36.416Z Restarting Chrome
2019-03-22T18:36:36.433Z got 200 in 20158ms for https://www.activitree.com/education/type=all&curr=Canadian
2019-03-22T18:36:36.434Z Chrome connection closed... restarting Chrome
2019-03-22T18:36:36.434Z Starting Chrome
2019-03-22T18:36:36.953Z Started Chrome: HeadlessChrome/73.0.3683.75
Env vars on the Prerender Node side:
BLACKLISTED_DOMAIN: engine.montiapm.com,maps.googleapis.com,www.googletagmanager.com,googletagmanager.com,www.google-analytics.com,google-analytics.com,connect.facebook.net,lc.iadvize.com,fonts.gstatic.com,gstatic.com,i.ytimg.com,www.youtube.com,vimeo.com,www.vimeo.com,baidu.com,f.vimeocdn.com,fresnel.vimeocdn.com,player.vimeo.com,i.vimeocdn.com,youtube.com,player.youtube.com,stats.g.doubleclick.net,static.iadvize.com,api.iadvize.com
BLACKLISTED_DOMAINS: ['engine.montiapm.com', 'maps.googleapis.com']
BLACKLISTED_EXTS: ico,jpg,jpeg,png,ttf,eot,otf,woff,woff2,gif,svg,pdf,css,svg
from prerender-request-blacklist.
Related Issues (1)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from prerender-request-blacklist.