Tuesday, November 27, 2018
Tuesday, February 20, 2018
Unstuck npm install
- Check your "npm config get proxy"
- rm -rf package-lock.json
Wednesday, August 24, 2016
Making Impala connection from Python on Windows (compiling lib SASL)
- Install Microsoft Visual C++ Compiler for Python 2.7 (see https://blogs.msdn.microsoft.com/pythonengineering/2016/04/11/unable-to-find-vcvarsall-bat/ for more background)
- Copy stdint.h from http://msinttypes.googlecode.com/ (downloaded an archive) to "%USERPROFILE%\AppData\Local\Programs\Common\Microsoft\Visual C++ for Python\9.0\VC\include" (I'm running on Windows 2008 R2 x64). See http://deeplearning.net/software/theano/install_windows.html#visual-studio-and-cuda for more background
- Create "%USERPROFILE%\AppData\Local\Programs\Common\Microsoft\Visual C++ for Python\9.0\VC\include\unistd.h"
#ifndef _UNISTD_H #define _UNISTD_H 1 /* Values for the second argument to access. These may be OR'd together. */ #define R_OK 4 /* Test for read permission. */ #define W_OK 2 /* Test for write permission. */ //#define X_OK 1 /* execute permission - unsupported in windows*/ #define F_OK 0 /* Test for existence. */ #define access _access #define dup2 _dup2 #define execve _execve #define ftruncate _chsize #define unlink _unlink #define fileno _fileno #define getcwd _getcwd #define chdir _chdir #define isatty _isatty #define lseek _lseek #define ssize_t unsigned int #define STDIN_FILENO 0 #define STDOUT_FILENO 1 #define STDERR_FILENO 2 char *getpass(const char *prompt) { return "Hello World!"; } #endif /* unistd.h */ git clone https://github.com/cyrusimap/cyrus-sasl
- Follow https://jira.mongodb.org/browse/CXX-645, specifically:
- Use "VS2013 x64 Native Tools Command Prompt"
- In cyrus-sasl\lib run
nmake /f ntmakefile STATIC=no prefix=C:\sasl64
. Note this uses /MD. - Run
nmake /f ntmakefile prefix=C:\sasl64 STATIC=no install
in cyrus-sasl\lib, cyrus-sasl\include, cyrus-sasl\win32\include - Rename C:\sasl64\lib\libsasl.lib to C:\sasl64\lib\sasl2.lib
- Create requirements.txt
impyla thrift_sasl pure-sasl
- Create Makefile
SCRIPTS_HOME=$(PYTHON_HOME)/Scripts PIP=$(SCRIPTS_HOME)/pip.exe pip-requirements: $(PIP) install -r requirements.txt --global-option=build_ext \ --global-option=-IC:\\sasl64\\include \ --global-option=-LC:\\sasl64\\lib - Run 'make pip-requirements PYTHON_HOME=C:\\Anaconda2-4.0.0'
Thursday, November 15, 2012
Marriage of CxxUnit and GMock
Based on "Using Google Mock with Any Testing Framework", CxxUnit Template Files and "Hello World" mocking examples we get:
1) provide CxxUnit with custom template for the main function:
CXXTESTGEN_FLAGS += \ --runner=ParenPrinter \ --template=C:\\src\\...\\TEMPLATE.tpl \ --have-eh \ --abort-on-failwhere TEMPLATE.ptl is something like:
<CxxTest preamble>
#include "gtest/gtest.h"
#include "gmock/gmock.h"
int main(int argc, char *argv[]) {
// The following line causes Google Mock to throw an exception on failure,
// which will be interpreted by your testing framework as a test failure.
::testing::GTEST_FLAG(throw_on_failure) = true;
::testing::InitGoogleMock(&argc, argv);
// whatever your testing framework requires...
return CxxTest::GuiTuiRunner<CxxTest::Win32Gui, CxxTest::ParenPrinter>(argc, argv).run();
}
// The CxxTest "world"
<CxxTest world>
this will result into something like:
/* Generated file, do not edit */
#ifndef CXXTEST_RUNNING
#define CXXTEST_RUNNING
#endif
#define _CXXTEST_HAVE_STD
#define _CXXTEST_HAVE_EH
#define _CXXTEST_ABORT_TEST_ON_FAIL
#include <cxxtest/TestListener.h>
#include <cxxtest/TestTracker.h>
#include <cxxtest/TestRunner.h>
#include <cxxtest/RealDescriptions.h>
#include <cxxtest/ParenPrinter.h>
#include <cxxtest/Win32Gui.h>
#include "gtest/gtest.h"
#include "gmock/gmock.h"
int main(int argc, char *argv[]) {
// The following line causes Google Mock to throw
// an exception on failure, which will be interpreted
// by your testing framework as a test failure.
::testing::GTEST_FLAG(throw_on_failure) = true;
::testing::InitGoogleMock(&argc, argv);
// whatever your testing framework requires...
return CxxTest::GuiTuiRunner<CxxTest::Win32Gui, CxxTest::ParenPrinter>
(argc, argv).run();
}
// The CxxTest "world"
#include "C:/src/.../HelloGMockTest.h"
2) reference the library:
LD_OPTS += -libpath:C:\\...\\win32\\gmock-1.4.0-vc90sp1\\lib-debug LIBS = ... gmock.lib
3) run tests:
class Foo{
public:
virtual ~Foo() {}
virtual void doSomethingUseful() = 0;
};
class Bar
{
public:
void addFoo(Foo& f)
{
// comment to fail
f.doSomethingUseful();
}
};
class MockFoo : public Foo
{
public:
MOCK_METHOD0(doSomethingUseful, void());
};
void testGTestPass() {
EXPECT_EQ(42, 42);
}
void testGTestFail() {
EXPECT_EQ(42, 41);
}
void testGMock() {
// Create Mock and set up expectations.
MockFoo foo;
EXPECT_CALL(foo, doSomethingUseful()).Times(1);
// Use the mock type in test type.
Bar bar;
bar.addFoo(foo);
// Verify that Bar has done the expected thing with Foo. Will fail and give descriptive message if not.
TSM_ASSERT("Bar has not used Foo as expected.", ::testing::Mock::VerifyAndClearExpectations(&foo));
}
A couple of gotchas:
- don't link against gmock_main.lib as it will mask your "main" function
- link against debug version (if you use /MT or /MD flags) of the lib or you'll get "warning LNK4098: defaultlib 'msvcrt.lib' conflicts with use of other libs; use /NODEFAULTLIB:library" and your test will crash
That's it for now :)
Sunday, November 2, 2008
J2ME MIDlet signing process using own Certificate Authority (CA)
Introduction
The Java Platform is very well known as very powerful and reliable software development platform. However, sometimes it's difficult to get started using some of its feature. The purpose of this article is to show how to sign J2ME MIDlet using custom CA , deploy and test it on a mobile phone. The process will be demonstrated using HTC phone which allows installation of custom root certificates. We will generate an intermidiate certificate signed by the root certificate and intended to represent our imaginary company ByMobile. Users will have to install the root certificate into their mobile phones manually as described below.
Other phones (for example Sony Ericsson K550i) may not allow you to install such custom root certificate, so you'll have to sign your intermidiate sertificate using VeriSign which will cost you some money. This will work because VeriSign has preinstalled root cetificates on most mobile phones (like Sony Ericsson), so you don't have to worry about users installing them separately.
This article will be largely based on several others. The first part will be similar to one described in HOWTO Build, Sign and Install MIDlets. That article was written a couple of years ago and some of the tools are not available any more. Some of the steps and build scripts will be based on ones described in MIDlet jar signing (a tutorial) Revised.
Environment
Ubuntu Linux 8.4, Sun JDK 1.6.0_07, WTK 2.5.2, IntelliJ IDEA 8.0 (build 8664), HTC Touch Dual (Windows Mobile 6 Professional), OpenSSL 0.9.8i, antenna 1.1.0-beta and preprocessor-v3-1.2
Step 1
Ok, let's get started. One of our main subtasks is to enable our imaginary company ByMobile to sign MIDlet's. For that we need a public/private key pair and a certificate which include our public key and will be signed by trusted CA (for example VeriSign or our custom CA).
So. the first thing we need to do is to generate a public/private key pair (see full description of the tool at keytool-Key and Certificate Management Tool):
keytool -genkey -alias code-sign -keyalg RSA -validity 365 -keystore code-sign.ks
We'll need to enter our keystore password (which will be passwd in this example) twice to create our new keystore.
Then we need to enter:
name = AndriiNeverov
unit = Dev
org = ByMobile
city = Lyngby
state = Copenhagen
country = DK
Confirm and enter key's password which will be the same as keystore's one in this example.
Now we can check if the key was actually created:
keytool -list -keystore code-sign.ks
which gives us:
Keystore type: JKS
Keystore provider: SUN
Your keystore contains 1 entry
code-sign, Nov 2, 2008, PrivateKeyEntry,
Certificate fingerprint (MD5): 4B:60:3E:24:64:4E:0D:C3:E7:D3:07:A2:EE:72:CE:CB
The next thing we need to do is to generate certificate requst to be able to give our signed certificate to users to verify our signatures:
keytool -certreq -alias code-sign -keystore code-sign.ks -storepass passwd -keypass passwd -file code-sign-request-PKCS10.csr
This gives us file code-sign-request-PKCS10.csr which we need to send to the trusted CA (for xample VeriSign) for signature. For the purpose of this article we will create our own trusted CA.
Step2
Create a key for our CA:
openssl genrsa -des3 -out ca-key.key 4096
Enter our password (passwd) twice. Now we have a key stored in ca-key.key
Generate CA public certificate in DER format:
openssl req -new -x509 -days 365 -key ca-key.key -outform DER -out ca-cert-DER-PKCS10.cer
Enter password.
Enter:
county = DK
state = Copenhagen
city = Lyngby
company = ByMobile
unit = Headquaters
common name = ByMobileRootCert
email =
Generate CA public certificate in PEM format:
openssl req -new -x509 -days 365 -key ca-key.key -out ca-cert-PEM-PKCS10.crt
Repeat the same information as the above.
Step 3
Sign certificate request with created root certificate. The result is an intermidiate certificate which represents our imaginary company's public key:
openssl x509 -req -days 365 -in code-sign-request-PKCS10.csr -CA ca-cert-PEM-PKCS10.crt -CAkey ca-key.key -set_serial 01 -out code-sign-cert-PEM-X509.crt
Enter passwd.
The result is leaf certificate code-sign-cert-PEM-X509.crt. However, leaf certificate is NOT valid without root certificate by which it's signed. So, we need to combine both certificates together.
Step4
Now we need to combine root certificate and our leaf certificate in one file in PKCS#7 format.
Open Internet Explorer
Open certificate manager (Tools->Internet Options->Content->Certificates)
Pick “Trusted Root Certification Authorities” tab and Click “Import”
Click “Next” and choose path to your ca-cert-PEM-PKCS10.crt file and click “Next”
Pick certificate store as “Trusted Root Certification Authorities” and continue until it says imported.
Now pick “Intermediate Certification Authorities” tab import certificate code-sign-cert-PEM-X509.crt like you did for ca-cert-PEM-PKCS10.crt. Once successfully imported, you’ll see the code-sign certificate among intermediate certificates.
In “Intermediate Certification Authorities” select your code-sign certificate and click “Export”
Succeeding screen will prompt you to choose the format. Pick PKCS#7 (.P7B). and check “include all certificates in the certification path if possible” checkbox (very important)
Continue by clicking next and pick a file name (say code-sign-combined-PKCS7.p7b)
Continue till it says successfully exported and you should see a file by name code-sign-combined-PKCS7.p7b has been created.
Important: Pay special attention to step 8, If you do not check "include all certificates..." you will not be able to sign your MIDlet.
Step 5
Now it's time to install our combined reply back to the keystore. It's better to mak a backup copy of your keystore in case something goes wrong. This is very important step and we need to install reply to exactly the same alias as we used to generate a public/private key pair for our imaginary company:
keytool -import -alias code-sign -keystore code-sign.ks -file code-sign-combined-PKCS7.p7b
... is not trusted. Install reply anyway? [no]: yes
Certificate reply was installed in keystore
Step 6
Ok, now as we have our intermidiate certificate in the keystore and we're ready to sign our test MIDlet.
Test project consists of 4 sub-projects:
- Simple – MIDlet which shows Java logo image which is stored locally as a resource. Intended to verify that deployment actually works.
- Untrusted – MIDlet which shows Java logo image obtained from Internet. Intended to verify that all network access attempts are controlled by JAM.
- Trusted – MIDlet which shows Java logo image obtained from Internet and is signed by our imaginary company. Intended to verify that all network access attempts are permitted
- Web – web application which allows user to download midlets and root certificate via OTA.
- Open project in IDEA
- Rebuild project
- Copy Simple.jad and Simple.jar from Simple to Web/web (near index.jsp)
- Copy Untrusted.jad and Untrusted.jar from Untrusted to Web/web (near index.jsp)
- Add references to antenna and preprocessor for IDEA's Ant
- Run deploy task
- Copy Trusted.jad and Trusted.jar from MIDletSigningTest/out/signed to Web/web (near index.jsp)
- Refresh Web module
- Copy Security/ca-cert-DER-PKCS10.cer from Trusted to Web/web (near index.jsp)
- Rebuild project
Now we can test it using WTK's emulator:
- Run ktoolbar
- File > Create project form JAD/JAR
- Select MIDletSigningTest/out/signed/Trusted.jad
- File > Utilities > Manage Certificates
- Import certificate > Security/ca-cert-DER-PKCS10.cer from Trusted > Manufacturer
- Close
- Close
- Project > Run via OTA
Check whether it works. Although Sun's emulator sometimes seems like fragile, my experience shows that if something doesn't run inside it, it will most likely have problem in real phone.
Let's check it on a real mobile phone (HTC, WM6):1. Deploy MIDletSigningTest/out/Web.war to some server (I recommend eatj.com, because it's free and quite decent Java web hosting )
2. Go to your server (I did this with a page on eatj.com)
3. Install Simple
Notice that it asks whether to install untrusted MIDlet
4. Run it
5. Install Untrusted
Notice that it asks whether to install untrusted MIDlet
Notice that it asks whether to transfer data from network
Notice that it asks whether to allow net access and there are two options:
- ask me next session
- ask me next time
6. Install Trusted
Notice that it fails with message like “The root certificate used for Trusted cannot be found”
7. Click on Root Certificate ByMobile CA and check "Open file after download"
Notice that it says that one or more certificates were installed successfully
8. Install Trusted
Notice that it says that Trusted is signed by ByMobile, DK
Notice that it asks for Connector.http permissions (it's important to state necessary permissions explicitly, otherwise it will install, but fails later)
Notice that it asks whether to transfer data from network
Notice that it asks whether to allow net access and there are two options:
- don't ask
- ask me next session
- ask me next time
If you chose don't ask, it will never ask again for this app, even after phone restart
Go to Notice in Settings > System > Certificates > Root
the last certificate is the Root Cert ByMobile CA
Conclusion
As we can see Java Platform plays very well with all standards including those related to security. Using described techniques you should be able to leverage the full power of Java on your mobile phones as much as you do on the server side or desktops. Although the setup may seem to be a bit complex, the problem is solvable using a set of flexible tools available out there. This is a common pattern with Java. I hope this document and provided build scripts help you to build your mobile applications quickly and efficiently.Enjoy your signed mobile applications! ;)
TODO
- Update certificates combining process to be performed using OpenSSL instead of IE.
- Provide central Ant build script to eliminate all the manual steps and make the process to be fully automated.
