khoben / telemirror Goto Github PK

Sir your repository all telegram very best
Please sir add delete option

How do I not send messages that words from a blacklist?

blacklist = ball
message "you kicked my ball"

channel > filter all text > if all ok > send
channel > filter all text > if not ok > ignore (on example above)

HI,
thank's for your work,
I enable the forward of restrict channel.
i uncommented this

Skip 'restricted saving content' enabled
on event on_new_message

there is a way for this channel mirror only the text , maybe the image (saving to array) ?
(i see one old post)

I can skip all the other element , audio, album etc.. ?
In few word i'm try to avoid the ban, and i'm interested on only text part and maybe images of every message.

Thank's

Is it possible to forward a message to channel topic with this bot? Usual channel ID is: -100?????, channel topic ID is: -100?????_111111

ru.
В примере указана переменная targets, которая по идее не должна быть обязательна.
При её удалении в цикле обработки конфига возникает ошибка.
eng.
The example specifies the variable targets, which in theory should not be required.
When it is deleted, an error occurs in the config processing cycle.

where i put keywords ?

class SkipWithKeywordsFilter(MessageFilter):
    """Skips message if some keyword found
    """
    def __init__(self, keywords: set[str]) -> None:
        self._regex = re.compile(
            '|'.join([f'\\b{k}\\b' for k in keywords]), flags=re.IGNORECASE)

    async def process(self, message: EventMessage) -> Tuple[bool, EventMessage]:
        if self._regex.search(message.message):
            return False, message
        return True, message

Autu edit option good
Please add auto delete option

As I've been using telemirror for a while now and came to test all of its features. I can confirm that it pulls content from restricted channels but just not media (images,videos). I just want to confirm if this is a problem from my side or its something that cannot be achieved ?

Traceback (most recent call last):
File "/usr/local/lib/python3.11/asyncio/tasks.py", line 500, in wait_for
return fut.result()
^^^^^^^^^^^^
File "/app/dependencies/telethon/client/telegrambaseclient.py", line 544, in connect
if not await self._sender.connect(self._connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/dependencies/telethon/network/mtprotosender.py", line 132, in connect
await self._connect()
File "/app/dependencies/telethon/network/mtprotosender.py", line 232, in _connect
connected = await self._try_connect(attempt)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/dependencies/telethon/network/mtprotosender.py", line 282, in _try_connect
await self._connection.connect(timeout=self._connect_timeout)
File "/app/dependencies/telethon/network/connection/connection.py", line 244, in connect
await self._connect(timeout=timeout, ssl=ssl)
File "/app/dependencies/telethon/network/connection/connection.py", line 216, in _connect
self._reader, self._writer = await asyncio.wait_for(
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/tasks.py", line 476, in wait_for
await waiter
asyncio.exceptions.CancelledError
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/app/telemirror/mirroring.py", line 504, in __connect_client
await asyncio.wait_for(client.connect(), timeout=client._timeout)
File "/usr/local/lib/python3.11/asyncio/tasks.py", line 502, in wait_for
raise exceptions.TimeoutError() from exc
�
TimeoutError
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/app/main.py", line 105, in
main()
File "/app/main.py", line 91, in main
asyncio.run(
File "/usr/local/lib/python3.11/asyncio/runners.py", line 190, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
File "/app/main.py", line 66, in run_telemirror
await telemirror.run()
File "/app/telemirror/mirroring.py", line 581, in run
await self._mirroring.run()
File "/app/telemirror/mirroring.py", line 480, in run
await self.__connect_client(self._sender)
File "/app/telemirror/mirroring.py", line 506, in __connect_client
raise RuntimeError(
RuntimeError: Timeout error while connecting to Telegram server, try restart or get a new session key (run login.py)

What I dd wrong?

How currently this feature writes in config?
Also, maybe create fully exampled referenced configuration?

It's working fine with all the topics except the default one and when I'm only adding only the group id it's forwarding all topics in a single group topic

How can setup this on Heroku ?

Thanks

Is there a possibility to ignore messages that contain audio, video or image?

Heroku web process failed to bind to $PORT within 60 seconds of launch:

Feature Request:

Include a feature to set YAML file contents directly via environment variables. This would streamline deployment on platforms like Heroku, eliminating the need for manual YAML file creation when the repository is cloned and made private.

Так и не получилось запустить код, если не сложно сделай инструкцию для чайников. Через 9 дней удаляют мой любимый канал по причине неактива его автора. Нужно срочно его отзеркалить.

how to get string session?
im not understand after try manytimes

Hi, Thanks for creating repo.
I have one problem while using this, whenever there is a replied message which was not cached earlier I mean when any older message is replied which was send before running the bot. It can't forward that message.
It throws this error

`2022-09-20T04:15:35.939775+00:00 app[run.1]: ERROR:main:'NoneType' object is not iterable

2022-09-20T04:15:35.939777+00:00 app[run.1]: Traceback (most recent call last):

2022-09-20T04:15:35.939778+00:00 app[run.1]: File "/app/telemirror/mirroring.py", line 45, in on_new_message

2022-09-20T04:15:35.939778+00:00 app[run.1]: reply_to_messages: dict[int, int] = {

2022-09-20T04:15:35.939778+00:00 app[run.1]: TypeError: 'NoneType' object is not iterable`

Any solution for this?

Anyone got any thoughts on why this maybe?

Traceback (most recent call last):
  File "C:\Users\Administrator\AppData\Local\Programs\Python\Python312\Lib\site-packages\aiohttp\web_protocol.py", line
350, in data_received
    messages, upgraded, tail = self._request_parser.feed_data(data)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "aiohttp\\_http_parser.pyx", line 557, in aiohttp._http_parser.HttpParser.feed_data
aiohttp.http_exceptions.BadStatusLine: 400, message:
  Invalid method encountered:

    b'\x16\x03\x01'
      ^
Error handling request
Traceback (most recent call last):
  File "C:\Users\Administrator\AppData\Local\Programs\Python\Python312\Lib\site-packages\aiohttp\web_protocol.py", line
350, in data_received
    messages, upgraded, tail = self._request_parser.feed_data(data)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "aiohttp\\_http_parser.pyx", line 557, in aiohttp._http_parser.HttpParser.feed_data
aiohttp.http_exceptions.BadStatusLine: 400, message:
  Invalid method encountered:

    b'nil'
      ^

I see in past someone ask this feature.
I'm a newbie on python so i'm not skilled to modify your code.

Usefull feature it's to replace some Word , or Phrase with another one.
Real Scenario :

For example i have an Expert Advisort in MT4 that read signal from telegram, using of course a Telegram BOT, so the bot must be the administrator of channel.

I need to mirror original channel on my channel (where i put the bot), and this is working fine and it's amazing.
Original channel it's a signal channel, free or payment and i have no influence on the format or text.

However my expert advisor (of couse i don't have source to modify this one) maybe read only TP and not TakeProfit, so when i copy to my channel i need to transform .
In the original Message he write "TakeProfit" i need to transform in "TP", or maybe write "trail stop loss to be" i need to transform to "Set SL"

Подскажите, SkipWithKeywordsFilter привязан к регистру? "подпишитесь" и "ПОДПИШИТЕСЬ" - одно и то же слово для исключения?

Было бы здорово реализовать gui добавление/удаление каналов из конфига. В качестве места обработки команд можно использовать сообщения с самим собой. В совершенстве это может быть реализовано с помощью бота, в котором было бы инлайн меню и который был бы связан с юзерботом. Также жду предложенной ранее функции фильтрации повторных сообщений. Готов внести пожертвование ради таких "премиум" функций

everything is fine but it seems that i can't find mirror.config.yml where to find it?
and if i have to make it how to exactly?

thanks for your great work and keep up the good work <3

Здравствуйте. Хотел бы попробовать вашу библиотеку для пересылки сообщений из своего закрытого канала в публичный. На основе этого у меня есть пара вопросов:

1. Есть ли в планах ввести настройку задержки между публикациями сообщений?
2. Реализованы ли у вас какие-нибудь механизмы уменьшения риска бана? Я пробовал несколько других библиотек и через определенное время номер улетал в бан. Хоть номер и восстанавливали, но часто испытывать поддержку тг не хочется. Номер участвовавший в тесте старый, плотность сообщений в группе не высокая, но иногда интервал между сообщениями может быть меньше 2-3 минут.

hi khoben ,
please make filter & replace for exceptions for multiple words.for exam if find value-a in post descriptions can replace with custom one & can set multi env value for multiple values replacement.
for expert mode if you can set ( must have word/must not have ) mode for can be repost in destination channel , it's so much useful.
it means in must have mode , must in post description find value1 & if can't find bypass that post for repost & vice versa for must not have mode.
waiting for your changes commits :)
finest regards
goodbye

How to replace links in telegram markdown formatted message?

2022-05-13T09:14:17.906673+00:00 app[run.1]: ValueError: Not a valid string
2022-05-13T09:14:18.067854+00:00 heroku[run.1]: Process exited with status 1
2022-05-13T09:14:18.317335+00:00 heroku[run.1]: State changed from up to crashed
2022-05-13T09:15:03.498661+00:00 heroku[router]: at=error code=H14 desc="No web processes running" method=GET path="/"

Привет, спасибо еще раз за программу. Столкнулся, что программа может рандрмно пропускать посты при копировании в каналы. В чем может быть дело, куда копать? Крутиться в докере на виртуалке. Оперативной памяти и мощности проца судя по графикам хватает. Спасибо

Any way to use this great utility on docker?
I am planning to use it on my synology nas Docker.

It's works fine for forwarding of new messages. But how to forward previous messages.
I want to forward all messages in a channel to another channel

Привет, спасибо за программу, она супер. Переписал, чтобы пересылались сообщения с заданными словами (вместо пропуска). Никак не могу сделать не точный поиск по словам. Как изменить код, чтобы поиск осуществлялся по неточному совпадению, например, искало все слова, в которых встречается "дом" (домик, домкрат и тп). И можно ли через одну строку задать неточный поиск по нескольким ключивым словам?

Еще видел, что в предыдущих релизах у тебя фильтр прикручивался к конкретному каналу. Можно ли вернуть данную опцию? А то для нескольких каналов с разными ключевыми словами надо будет запускать несколько версий программы.

Спасибо

Привет. Спасибо еще раз з программу. Сейчас собираю сообщения с чатов, возникла необходимость отсеивать (не пересылать) репосты с публичных каналов. Каким образом это можно сделать? Заранее спасибо за ответ

Hello,
thank you for the tool, it's great and works very well. The only problem I have is that i sometimes have a delay from 10-30 seconds. Sometimes its only 1 second what is fine because for my use case, I need as minimal delay as possible. Are there ways to reduce the delay, could it be due to the code or is it related to the Telegram API or the source channels?
I tried different settings and have a minumum config (only in .env file - i dont use the filter file):
Thats how my .env file looks:
API_ID=123
API_HASH=123
SESSION_STRING=123
USE_MEMORY_DB=true
CHAT_MAPPING=[-10012345678:-10012345678910];
YAML_CONFIG_ENV=\ndisable_edit: true\ndisable_delete: true\nmode: forward\n\n# (Required) Mirror directions\ndirections:\n - from: [-10012345678:]\n to: [-10012345678910]\n\n

The new message in the source channel gets recognized sometimes with a lot of delay, i watched it live now and the tg timestamp of the source channel was: 20:55:13
Then nothing happened a long time and then the messagee showed up in cli:
INFO 2024-02-26 19:56:02,874 [mirroring.py:69]:telemirror: [New message]: https://t.me/c/123254346/25352

And then the message got delivered in my channel with the timestamp 20:56:04.
Do you have any idea to improve that?

Best regards

Было бы здорово иметь фильтр проверки на оригинальность последних 10-50 сообщений. Очень часто многие каналы пересылают свои посты между собой, в следствие чего происходит их дублирование. У сообщения есть уникальный id, который сохраняется при пересылке?
Если нет, то возможно хотя бы фильтровать текст этих сообщений, по начальным словам.

Can you add the above function to the new version? I look forward to your new release. Thanks a lot.

Как включить пересылку текста и медиа из приватных каналов? Где именно нужно поменять настройки и где добавить сохранение файла для последующей отправки?

a function to change specific words, example, in the message I forwarded had the word "flowers" and I want to change this word "flowers" to "hello

Add multiple accounts to avoid blocking
At the same time, add a web version form to help manage accounts and channel forwarding

With SkipWithKeywordsFilter you can specify keywords and messages won't get forwarded if they contain those keywords.

Is there an option to SkipWithOUTKeywordsFilter, where you have a list of keywords (whitelists) and if the message contains any of the keywords from whitelist only then it gets forwarded?

hi,
The idea of mirroring is very good.
I am specially looking for a Clone Reply feature.in the latest version of telemirror,
Suppose the original channel sends a message then receiver gets a new message.
but when original channel reply's to that message, Receiver gets a new message instead of reply to prior message.

is there any option for that??

please tell me if you can help set it up

telemirror_1  | Traceback (most recent call last):
telemirror_1  |   File "/app/telemirror/mirroring.py", line 196, in on_edit_message
telemirror_1  |     await self.edit_message(
telemirror_1  |   File "/usr/local/lib/python3.11/site-packages/telethon/client/messages.py", line 1212, in edit_message
telemirror_1  |     msg = self._get_response_message(request, await self(request), entity)
telemirror_1  |                                               ^^^^^^^^^^^^^^^^^^^
telemirror_1  |   File "/usr/local/lib/python3.11/site-packages/telethon/client/users.py", line 30, in __call__
telemirror_1  |     return await self._call(self._sender, request, ordered=ordered)
telemirror_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
telemirror_1  |   File "/usr/local/lib/python3.11/site-packages/telethon/client/users.py", line 84, in _call
telemirror_1  |     result = await future
telemirror_1  |              ^^^^^^^^^^^^
telemirror_1  | telethon.errors.rpcerrorlist.MessageNotModifiedError: Content of the message was not modified (caused by EditMessageRequest)

При любом удаленном сообщении в логах докера срабатывает traceback, но сообщение всё равно удаляется.

Hi, I'm currently testing forwards from channel to channel,
Whenever I try to test it by sending a message I get this error

`INFO:main:Channel mirroring has started with config:
Mirror mapping:
-1001748000891 -> -1001621765064
Message deleting: Enabled
Message editing: Enabled
Installed message filter: ForwardFormatFilter
Using database: InMemoryDatabase

ERROR:telethon.client.updates:Unhandled exception on on_new_message
Traceback (most recent call last):
File "/home/xyz/.local/lib/python3.9/site-packages/telethon/client/updates.py", line 454, in _dispatch_update
await callback(event)
File "/home/xyz/Desktop/telemirror/telemirror/mirroring.py", line 24, in on_new_message
if event.message.chat.noforwards:
AttributeError: 'Channel' object has no attribute 'noforwards'`