Connecting ESP32-Cam with SMTP Email Sending to Firebase RTDB

[samgonzaga]

Hello, I am trying to connect my already functioning ESP32-Cam that can send a taken image via SMTP server. So far the Camera SMTP Code only works by itself, also the Firebase RTDB Code. But I want the camera to send a value to RTDB as well, and also get that value so I am trying to combine both. Is this possible? I am getting this error.

I am using these libraries:

**esp mail client version 3.4.15
firebase esp32 client version 4.4.10

Here is my code, i have removed my firebase, email, and wifi credentials.

`#include "esp_camera.h"
#include "SPI.h"
#include "driver/rtc_io.h"
#include <ESP_Mail_Client.h>
#include <FS.h>
#include <WiFi.h>
#include "FirebaseESP32.h"

// REPLACE WITH YOUR NETWORK CREDENTIALS
const char* ssid = "//";
const char* password = "//";

// Provide the token generation process info.
#include <addons/TokenHelper.h>

// Provide the RTDB payload printing info and other helper functions.
#include <addons/RTDBHelper.h>

/* 2. Define the API Key */
#define API_KEY "//"

/* 3. Define the RTDB URL */
#define DATABASE_URL "https://trial-c37b4-default-rtdb.firebaseio.com/" //.firebaseio.com or ..firebasedatabase.app

/* 4. Define the user Email and password that alreadey registerd or added in your project */
#define USER_EMAIL "//"
#define USER_PASSWORD "//"

// Define Firebase Data object
FirebaseData fbdo;

FirebaseAuth auth;
FirebaseConfig configF;

unsigned long count = 0;
float irdistance;
float irdistancefb;
int ir_duration;

// To send Email using Gmail use port 465 (SSL) and SMTP Server smtp.gmail.com
// You need to create an email app password
#define emailSenderAccount "//"
#define emailSenderPassword "//"
#define smtpServer "smtp.gmail.com"
#define smtpServerPort 465
#define emailSubject "ESP32-CAM Photo Captured"
#define emailRecipient "//"

#define CAMERA_MODEL_AI_THINKER

#if defined(CAMERA_MODEL_AI_THINKER)
#define PWDN_GPIO_NUM 32
#define RESET_GPIO_NUM -1
#define XCLK_GPIO_NUM 0
#define SIOD_GPIO_NUM 26
#define SIOC_GPIO_NUM 27
#define Y9_GPIO_NUM 35
#define Y8_GPIO_NUM 34
#define Y7_GPIO_NUM 39
#define Y6_GPIO_NUM 36
#define Y5_GPIO_NUM 21
#define Y4_GPIO_NUM 19
#define Y3_GPIO_NUM 18
#define Y2_GPIO_NUM 5
#define VSYNC_GPIO_NUM 25
#define HREF_GPIO_NUM 23
#define PCLK_GPIO_NUM 22
#else
#error "Camera model not selected"
#endif

/* The SMTP Session object used for Email sending */
SMTPSession smtp;

/* Callback function to get the Email sending status */
void smtpCallback(SMTP_Status status);

// Photo File Name to save in LittleFS
#define FILE_PHOTO "photo.jpg"
#define FILE_PHOTO_PATH "/photo.jpg"

void setup() {
WRITE_PERI_REG(RTC_CNTL_BROWN_OUT_REG, 0); //disable brownout detector

Serial.begin(115200);
Serial.println();

// Connect to Wi-Fi
WiFi.begin(ssid, password);
Serial.print("Connecting to WiFi...");
while (WiFi.status() != WL_CONNECTED) {
delay(500);
Serial.print(".");
}
Serial.println();

// Print ESP32 Local IP Address
Serial.print("IP Address: http://");
Serial.println(WiFi.localIP());

Serial.printf("Firebase Client v%s\n\n", FIREBASE_CLIENT_VERSION);

/* Assign the api key (required) */
configF.api_key = API_KEY;

/* Assign the user sign in credentials */
auth.user.email = USER_EMAIL;
auth.user.password = USER_PASSWORD;

/* Assign the RTDB URL (required) */
configF.database_url = DATABASE_URL;

/* Assign the callback function for the long running token generation task */
configF.token_status_callback = tokenStatusCallback; // see addons/TokenHelper.h

// Comment or pass false value when WiFi reconnection will control by your code or third party library e.g. WiFiManager
Firebase.reconnectNetwork(true);

// Since v4.4.x, BearSSL engine was used, the SSL buffer need to be set.
// Large data transmission may require larger RX buffer, otherwise connection issue or data read time out can be occurred.
fbdo.setBSSLBufferSize(4096 /* Rx buffer size in bytes from 512 - 16384 /, 1024 / Tx buffer size in bytes from 512 - 16384 */);

// Or use legacy authenticate method
// config.database_url = DATABASE_URL;
// config.signer.tokens.legacy_token = "";

// To connect without auth in Test Mode, see Authentications/TestMode/TestMode.ino

//////////////////////////////////////////////////////////////////////////////////////////////
// Please make sure the device free Heap is not lower than 80 k for ESP32 and 10 k for ESP8266,
// otherwise the SSL connection will fail.
//////////////////////////////////////////////////////////////////////////////////////////////

Firebase.begin(&configF, &auth);

Firebase.setDoubleDigits(5);

// Init filesystem
ESP_MAIL_DEFAULT_FLASH_FS.begin();

camera_config_t config;
config.ledc_channel = LEDC_CHANNEL_0;
config.ledc_timer = LEDC_TIMER_0;
config.pin_d0 = Y2_GPIO_NUM;
config.pin_d1 = Y3_GPIO_NUM;
config.pin_d2 = Y4_GPIO_NUM;
config.pin_d3 = Y5_GPIO_NUM;
config.pin_d4 = Y6_GPIO_NUM;
config.pin_d5 = Y7_GPIO_NUM;
config.pin_d6 = Y8_GPIO_NUM;
config.pin_d7 = Y9_GPIO_NUM;
config.pin_xclk = XCLK_GPIO_NUM;
config.pin_pclk = PCLK_GPIO_NUM;
config.pin_vsync = VSYNC_GPIO_NUM;
config.pin_href = HREF_GPIO_NUM;
config.pin_sccb_sda = SIOD_GPIO_NUM;
config.pin_sccb_scl = SIOC_GPIO_NUM;
config.pin_pwdn = PWDN_GPIO_NUM;
config.pin_reset = RESET_GPIO_NUM;
config.xclk_freq_hz = 10000000;
config.pixel_format = PIXFORMAT_JPEG;
config.grab_mode = CAMERA_GRAB_LATEST;

if(psramFound()){
config.frame_size = FRAMESIZE_UXGA;
config.jpeg_quality = 10;
config.fb_count = 1;
} else {
config.frame_size = FRAMESIZE_SVGA;
config.jpeg_quality = 12;
config.fb_count = 1;
}

// Initialize camera
esp_err_t err = esp_camera_init(&config);
if (err != ESP_OK) {
Serial.printf("Camera init failed with error 0x%x", err);
return;
}

capturePhotoSaveLittleFS();
sendPhoto();
}

void loop() {
/*
irdistancefb = Firebase.getFloat(fbdo, "/test/float");
Serial.println(irdistancefb);
ir_duration = Firebase.RTDB.get(fbdo, "/test/int");
//ir_duration = fbdo.to();
ir_duration = ir_duration * 1000;
Serial.println(ir_duration);
*/
Serial.printf("Set bool... %s\n", Firebase.setBool(fbdo, F("/test/bool"), count % 2 == 0) ? "ok" : fbdo.errorReason().c_str());

Serial.printf("Get bool... %s\n", Firebase.getBool(fbdo, FPSTR("/test/bool")) ? fbdo.to<bool>() ? "true" : "false" : fbdo.errorReason().c_str());

}

// Capture Photo and Save it to LittleFS
void capturePhotoSaveLittleFS( void ) {
// Dispose first pictures because of bad quality
camera_fb_t* fb = NULL;
// Skip first 3 frames (increase/decrease number as needed).
for (int i = 0; i < 3; i++) {
fb = esp_camera_fb_get();
esp_camera_fb_return(fb);
fb = NULL;
}

// Take a new photo
fb = NULL;
fb = esp_camera_fb_get();
if(!fb) {
Serial.println("Camera capture failed");
delay(1000);
ESP.restart();
}

// Photo file name
Serial.printf("Picture file name: %s\n", FILE_PHOTO_PATH);
File file = LittleFS.open(FILE_PHOTO_PATH, FILE_WRITE);

// Insert the data in the photo file
if (!file) {
Serial.println("Failed to open file in writing mode");
}
else {
file.write(fb->buf, fb->len); // payload (image), payload length
Serial.print("The picture has been saved in ");
Serial.print(FILE_PHOTO_PATH);
Serial.print(" - Size: ");
Serial.print(fb->len);
Serial.println(" bytes");
}
// Close the file
file.close();
esp_camera_fb_return(fb);
}

void sendPhoto( void ) {

/** Enable the debug via Serial port

• none debug or 0
• basic debug or 1
  */
  smtp.debug(1);

/* Set the callback function to get the sending results */
smtp.callback(smtpCallback);

/* Declare the session config data */
Session_Config config;

/*Set the NTP config time
For times east of the Prime Meridian use 0-12
For times west of the Prime Meridian add 12 to the offset.
Ex. American/Denver GMT would be -6. 6 + 12 = 18
See https://en.wikipedia.org/wiki/Time_zone for a list of the GMT/UTC timezone offsets
*/
config.time.ntp_server = F("ph.pool.ntp.org");
config.time.gmt_offset = 0;
config.time.day_light_offset = 1;

/* Set the session config */
config.server.host_name = smtpServer;
config.server.port = smtpServerPort;
config.login.email = emailSenderAccount;
config.login.password = emailSenderPassword;
config.login.user_domain = "";

/* Declare the message class */
SMTP_Message message;

/* Enable the chunked data transfer with pipelining for large message if server supported */
message.enable.chunking = true;

/* Set the message headers */
message.sender.name = "ESP32-CAM";
message.sender.email = emailSenderAccount;

message.subject = emailSubject;
message.addRecipient("VCII", emailRecipient);

String htmlMsg = "

Photo captured with ESP32-CAM and attached in this email.

";
message.html.content = htmlMsg.c_str();
message.html.charSet = "utf-8";
message.html.transfer_encoding = Content_Transfer_Encoding::enc_qp;

message.priority = esp_mail_smtp_priority::esp_mail_smtp_priority_normal;
message.response.notify = esp_mail_smtp_notify_success | esp_mail_smtp_notify_failure | esp_mail_smtp_notify_delay;

/* The attachment data item */
SMTP_Attachment att;

/** Set the attachment info e.g.

• file name, MIME type, file path, file storage type,
• transfer encoding and content encoding
  */
  att.descr.filename = FILE_PHOTO;
  att.descr.mime = "image/png";
  att.file.path = FILE_PHOTO_PATH;
  att.file.storage_type = esp_mail_file_storage_type_flash;
  att.descr.transfer_encoding = Content_Transfer_Encoding::enc_base64;

/* Add attachment to the message */
message.addAttachment(att);

/* Connect to server with the session config */
if (!smtp.connect(&config))
return;

/* Start sending the Email and close the session */
if (!MailClient.sendMail(&smtp, &message, true))
Serial.println("Error sending Email, " + smtp.errorReason());
}

// Callback function to get the Email sending status
void smtpCallback(SMTP_Status status){
/* Print the current status */
Serial.println(status.info());

/* Print the sending result */
if (status.success())
{
Serial.println("----------------");
Serial.printf("Message sent success: %d\n", status.completedCount());
Serial.printf("Message sent failled: %d\n", status.failedCount());
Serial.println("----------------\n");
struct tm dt;

for (size_t i = 0; i < smtp.sendingResult.size(); i++){
  /* Get the result item */
  SMTP_Result result = smtp.sendingResult.getItem(i);
  time_t ts = (time_t)result.timestamp;
  localtime_r(&ts, &dt);

  ESP_MAIL_PRINTF("Message No: %d\n", i + 1);
  ESP_MAIL_PRINTF("Status: %s\n", result.completed ? "success" : "failed");
  ESP_MAIL_PRINTF("Date/Time: %d/%d/%d %d:%d:%d\n", dt.tm_year + 1900, dt.tm_mon + 1, dt.tm_mday, dt.tm_hour, dt.tm_min, dt.tm_sec);
  ESP_MAIL_PRINTF("Recipient: %s\n", result.recipients.c_str());
  ESP_MAIL_PRINTF("Subject: %s\n", result.subject.c_str());
}
Serial.println("----------------\n");

// You need to clear sending result as the memory usage will grow up.
smtp.sendingResult.clear();
}
}`

[mobizt]

You have to know and keep in mind when you wrote your code under Arduino platform that.

YOU HAVE TO REMOVE ALL SD LIBRALIES IN ARDUINO LIBRARIES FOLDER THAT YOU INSTALLED BECAUSE IT CONFLICTS WITH THE SD LIBRARY OF CORE SDK.

[samgonzaga]

I'm on it sir, will post the complete error code here.

[samgonzaga]

This is not community forum but my public repository.

This requires investigation by me based on your information.

You just copy all information from IDE console or serial monitor and post it here.

ERROR_CODE-Ping TimeOut.txt

The code lines were too long for the comment so I pasted it in notepad instead.

[mobizt]

The error log you post does not contains the error you previously posted.

typename enable_if<is_string::value && is_same<T2, FirebaseJson *>::value, bool>::type
^
c:\Users\Abiels\Documents\Arduino\libraries\Firebase_ESP32_Client\src/rtdb/FB_RTDB.h:2770:16: error: expected initializer before 'enable_if'
typename enable_if<is_string::value && is_same<T2, FirebaseJson *>::value, bool>::type
^~~~~~~~~
c:\Users\Abiels\Documents\Arduino\libraries\Firebase_ESP32_Client\src/rtdb/FB_RTDB.h:2779:62: error: 'FirebaseJsonArray' was not declared in this scope
typename enable_if<is_string::value && is_same<T2, FirebaseJsonArray *>::value, bool>::type

[mobizt]

The error in your error log is because of third party library.
I know it from #error "Oops!" is not belong to my libraries.

C:\Users\Abiels\Documents\Arduino\blanksketchforlatestcamtest\blanksketchforlatestcamtest.ino:1:2: error: #error "Oops!"
#error "Oops!"

^~~~~

[samgonzaga]

Oh that one i adjust added it based on a recommendation on one of the forum I read. But even if I remove the "#error oops!" in the sketch file. it still returns the same errors sir.

[mobizt]

The latest version v4.4.10 causes some error about lwIP which I will fix it soon.

Please install the library version 4.4.8 instead.

After installed version 4.4.8, in your sketch, please include ESP_Mail_Client.h below the FirebaseESP32.h like the following.

#include <Arduino.h>
#include <WiFi.h>
#include <FirebaseESP32.h>
#include <ESP_Mail_Client.h>

[samgonzaga]

On it sir, will post the result here after compiling and testing.

[samgonzaga]

There are new errors which are somewhat different from the first one.
new errors.txt

[mobizt]

The error is because global libraries installation issue in Arduino platform which can cause compilation error when many libraries contain the same built-in dependencies with different include paths.

This problem is never existed in other well managed IDE e.g. PlatformIO that all libraries are installed locally for portability.

The workaround is you have to modify ESP Mail Client library by

1. Delete the src/SSLClient folder of ESP Mail Client library.
2. Replacing src/ESP_Mail_TCPClient.h at line 60 from #include "SSLClient/ESP_SSLClient.h" with #include "./client/SSLClient/ESP_SSLClient.h"

[samgonzaga]

Alright I'll do and test either one of those and check which one makes it work. Will update you, thanks!

[samgonzaga]

Good Day sir Mobizt. Just recently tested it and now I am able to compile and upload the code with no problem at all. Everything is working so far. Thanks for the awesome help!